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Abstract 

We study four systems and their interactions. First, we formulate a unified system 
of coupled forward-backward stochastic partial differential equations (FB-SPDEs) with 
Levy jumps, whose drift, diffusion, and jump coefficients may involve partial differen¬ 
tial operators. A solution to the FB-SPDEs is defined by a 4-tuple general dimensional 
random vector-field process evolving in time together with position parameters over a 
domain (e.g., a hyperbox or a manifold). Under an infinite sequence of generalized local 
linear growth and Lipschitz conditions, the well-posedness of an adapted 4-tuple strong 
solution is proved over a suitably constructed topological space. Second, we consider a 
unified system of FB-SDEs, a special form of the FB-SPDEs, however, with skew bound¬ 
ary reflections. Under randomized linear growth and Lipschitz conditions together with a 
general completely-iS condition on reflections, we prove the well-posedness of an adapted 
6-tuple weak solution with boundary regulators to the FB-SDEs by the Skorohod problem 
and an oscillation inequality. Particularly, if the spectral radii in some sense for reflection 
matrices are strictly less than the unity, an adapted 6-tuple strong solution is concerned. 

Third, we formulate a stochastic differential game (SDG) with general number of play¬ 
ers based on the FB-SDEs. By a solution to the FB-SPDEs, we get a solution to the 
FB-SDEs under a given control rule and then obtain a Pareto optimal Nash equilibrium 
policy process to the SDG. Fourth, we study the applications of the FB-SPDEs/FB-SDEs 
in queueing systems and quantum statistics while we use them to motivate the SDG. 
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1 Introduction 


We study four systems and their interactions: a unified system of coupled forward-backward 
stochastic partial differential equations (FB-SPDEs) with Levy jumps; a unified system of 
FB-SDEs, a special form of the FB-SPDEs, however, with skew reflections; a stochastic 
differential game (SDG) problem with general number of players based on the FB-SDEs; and 
a system of queues and their associated reflecting diffusion approximations. More precisely, 
there are four interconnected and streamlined aims involved in our discussions. 

The first aim is to study the adapted 4-tuple strong solution (17, V, V, V) to the uni¬ 
fied system of coupled FB-SPDEs with Levy jumps with respect to time-position parameter 
(L x) G R+ X D, 

G{x) + jQC{s-,x,U,V,V,V)ds 

+ flj{s-,x,U,V,V,V)dW{s) 

+ /o X(s-, X, U, F, F, F, z)N{\ds, dz), 

H{x) + // C{s-,x, U, F, F, V)ds 

+ j; Jis-,x,U,V,V,V)dW(s) 

fzh I{s-,x, U, F, F, F, z)N{Xds, dz), 


( 1 . 1 ) 


U{t,x) = 


V{t,x) = 


where, t G [0,r] and r G [0, T] is a stopping time with regard to a filtration defined later in 
the paper, — {0} or R^ for a positive integer h, and s~ denotes the corresponding 

left limit at time point s. In particular, D ^ RP with a given p £ J\f = {1, 2,...} is a connected 
domain, for examples, a p-dimensional box, a p-dimensional ball (or a general manifold), a 
p-dimensional sphere (or a general Riemannian manifold), or the whole Euclidean space R^ 
of real numbers itself. The F-SPDE in ()1.1[) is with the given initial random vector-field 
G, while the B-SPDE in (11.11) has the known terminal random vector-field H. In (11.11) . 
U and F are r-dimensional and q-dimensional random vector-field processes respectively, 
IF is a standard d-dimensional Brownian motion, and is a /i-dimensional centered Levy 
jump process (or centered subordinator). Furthermore, the partial differential operators 
of r-dimensional vector C, r x d-dimensional matrix J', and r x /i-dimensional matrix I 
are functionals of U, F, F, F, and their partial derivatives of up to the A:th order for 
k G {0,1,2, 3,...}. So do the partial differential operators of g-dimensional vector C, q x 
d-dimensional matrix jf, and q x h-dimensional matrix I. More precisely, for each A G 


( 1 . 2 ) 


A{s,x,U,V,V,V) = 


dU 

7l(s,x,(17,—,..., 


d^U 


dx''i...dx. 


(v|L. 


d^V 


dxi ax*L..5xp^ 

d^V 




dxi'"' 5x*L..9xp^ 


)(s,x), 
)(s,x), 
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dv d’^V 

dx^^...dx 


a;, •),•), 

p 


where the dot “•” in V{s,x, •) and its associated partial derivatives denotes the integration in 
terms of the so-called Levy measure. However, if ^ £ {X,X}, the last line on the right-hand 
side of (jl.2p should be changed to the form, 




d^V 


dx^^...dx^p 


■){s,x,z),z,-)- 


V(t,x) 



Figure 1: Sample Surface Solution to the FB-SPDEs 


Note that our partial differential operators presented in (II.2p can be general-nonlinear 
and high-order, e.g., 


A{s,x,U,V,V,V) = fi 


d^V{t,x) 

dx’^.-.dx^p 


for a general nonlinear functional /, where r,ii,...,ip are nonnegative integers satisfying 
ii + ... + ip = k with k G {0,1, 2,3,...}. Furthermore, the initial random vector-held G, 
the terminal random vector-hied H, and the 4-tuple solution process {U, V, V, V) can be 
complex-valued. 

Under an inhnite sequence of generalized local linear growth and Lipschitz conditions, we 
prove the existence and uniqueness of an adapted 4-tuple strong solution to the FB-SPDEs 
in a suitably constructed functional topological space. The solution to the unihed system in 
dEU) can be interpreted in a sample surface manner with time-position parameter (t, x) (see, 
e.g., V{t,x) in Figured] for such an example). The quite involved technical proof developed 
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in this paper is extended from our earlier work summarized in Dai m (arxiv, 2011) for a 
unified B-SPDE. 

More precisely, the newly unified system of coupled FB-SPDEs in dEU) covers many 
existing forward and/or backward SDEs/SPDEs as special cases, where the partial differ¬ 
ential operators are taken to be special forms. For examples, specific single-dimensional 
strongly nonlinear F-SPDE and B-SPDE driven solely by Brownian motions can be respec¬ 
tively derived for the purpose of optimal-utility based portfolio choice (see, e.g, Musiela and 
Zariphopoulou [38]). Here, the strong nonlinearity is in the sense addressed by Lions and 
Souganidis |34] and Pardoux |42] . Furthermore, the single-dimensional stochastic Hamilton- 
Jacobi-Bellman (HJB) equations are also examples of our unified system in ()l.ll) . which 
are specific B-SPDEs (see, e.g., 0ksendal et al. [JT] and references therein). Note that the 
proof of the well-posedness concerning solution to the B-SPDE derived in Musiela and Za¬ 
riphopoulou |38| and solution to the HJB equation derived in 0ksendal et al. [H] is covered by 
the study in Dai m (arxiv, 2011) although the authors in both [38j and 0ksendal et al. [41] 
claim it as an open problem. The proof of the well-posedness about solution to the F-SPDE 
derived in Musiela and Zariphopoulou [38] is covered by the even more unified discussion for 
the coupled FB-SPDEs in ()1.1|1 of this paper. Actually, partial motivations to enhance the 
unified B-SPDE in Dai [IT] (arxiv, 2011) to the coupled FB-SPDEs in ()1.1|1 are from the 
conference discussion [22] during 45 minutes invited talk presented by Zariphopoulou in ICM 
2014, where the current author claimed that the well-posedness of solution to the F-SPDE in 
[38] can be proved by the method developed in Dai m (arxiv, 2011). Besides these existing 
examples, our motivations to study the coupled FB-SPDEs in (11.11) are also from optimal 
portfolio management in finance (see, e.g., Dai mm), and multi-channel (or multi-valued) 
image regularization such as color images in computer vision and network applications (see, 
e.g., Caselles et al. m- In this part, we also show the usages of our unified system in (II.ip 
in heat diffusions and quantum Hall/anomalous Hall effects as two illustrative examples to 
support our first aim. Mathematically, we refine a stochastic Dirichlet-Poisson problem from 
heat diffusions and use stochastic Schrddinger equation as model for Hall effects in quantum 
statistics. 

It is worth to point out that the proving methodology developed in the current paper and 
its early version in Dai m (arxiv, 2011) is aimed to provide a general theory and framework 
to show the well-posedness of a unified general system class of the coupled FB-SPDEs in 
However, some specific forms of the FB-SPDEs in (|l.ip (either in forward manner or 
in backward manner) may be solved by alternative techniques, e.g., the author in his Fields 
Metal awarded work (Hairer [26] and ICM 2014) solves the KPZ equation by rough path 
technology, and furthermore, the related rough path theory can deal with the lack of either 
temporal or spatial regularity (see, e.g., Hairer [26] and reference therein). 

The second aim of the paper is to prove the well-posedness of an adapted 6-tuple weak 
solution {V,V ,V, F)) with 2-tuple boundary regulator {Y, F) to the (possible) non- 

Markovian system of coupled FB-SDEs with Levy jumps and skew reflections under a given 
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control rule u 


' x{t) = bit-,xit-),vit-),v{t-),v{t-,-),uit-,xit-),-)dt 

+ait-,Xit-), V{t-), V{t-), Vit-, ■),uit-,Xit-)), ■)dWit) _ 

+ Izh ■)N{dt, dz) 

+RdY{t), 

X(0) = X, 

fl 3 ) J = !llDAX{s))dY,{s)- 

I {V{t) = c{t-,X{t-),V{t-),V{t-),V{t-,-),u{t-,X{t-),-)dt 

-ait-,X{t-), Vit-), V{t-\V{t-, ■),uit-,Xit-)), ■)dW{t) ^ 

- Izh Cii~,X{t-), V(t-), V(t-), V(t-,z),u(t-,X(t-)),z, ■)N{dt, dz) 
-SdF{t), 

V{T) = H{X{T),-), 

, Rit) = filj:,^iV{s))dFiis). 

In (|1.3p . X is a p-dimensional process governed by the F-SDE with skew reflection matrix 
R and E is a ( 7 -dimensional process governed by the B-SDE with skew reflection matrix S. 
Furthermore, Y can increase only when X is on a boundary Di with i £ {1, 6 } and F can 
increase only when E is on a boundary Di with £ { 1 , 6 }, where b and b are two nonnegative 
integers. Both Y and F are the regulating processes with possible jumps to push X and V 
back into the state spaces D and D respectively. They are parts of the 6 -tuple solution 
to (11.31) and determined by solution pairs to the well-known Skorohod problem (see, e.g., 
Dai [13], Dai and Dai |12j . or Section [ 6 ] of the current paper for such a definition). Thus, we 
call them as Skorohod regulators (see, Figure [2] for such an example). Note that, comparing 
with the unified system in (11.11) . the coefficients appeared in ()1.3p do not contain any partial 
derivative operator but the FB-SDEs themselves involve skew boundary reflections. The 
proof for the well-posedness of an adapted 6 -tuple weak solution to the FB-SDEs is based on 
two general conditions. The first one is a general completely-5 condition (see, e.g., Dai m, 
Dai and Dai [T 2 |, and Figure [ 2 ] for an illustration). The non-uniqueness of solution to an 
associated Skorohod problem under this condition is one of the major difficulties in the 
proof. The second one is the generalized linear growth and Lipschitz conditions, where 
the conventional growth and Lipschitz constant is replaced by a possible unbounded but 
mean-squarely integrable adapted stochastic process (see, e.g., Dai mm)- In particular, if 
the completely-5 condition becomes more strict, e.g., with additional requirements that the 
spectral radii in certain sense for both reflection matrices are strictly less than the unity, a 
unique adapted 6 -tuple strong solution will be concerned. 

Concerning coupled FB-SDEs, it motivates a hot research area (see, e.g., 0ksendal et 
al. m about the discussion of coupled FB-SDEs with no boundary reflection, Karatzas and 
Li |31] about the study of Brownian motion driven B-SDE with reflection, and references 
therein). However, to our best knowledge, the coupled system in (II.3p with double skew 
reflection matrices and the well-posedness study in terms of an adapted 6 -tuple weak solution 
with Levy jumps and under a general completely-5 condition through the Skorohod problem 
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Skorohod 
Regulator at 



Figure 2: Skew and Inward Reflection with Skorohod Regulator under Completely-iS Condition 


are new and for the first time in this area. 

The third aim of the paper involves two folds. On the one hand, we use the 4-tuple solution 
to the coupled FB-SPDEs in (jl.ip to obtain an adapted 6-tuple solution to the system in 
(jl.3l) : On the other hand, we use the obtained adapted 6-tuple solution to determine a Pareto 
optimal Nash equilibrium policy process to a non-zero-sum SDG problem in (jl.4p . which is 
newly formulated by the FB-SDEs in (II.3j) . In this game, there are g-players and each player 
I G {!,...,(?} has his own value function subject to the system in (II.3p under an admissible 
control policy u. Every player I chooses an optimal policy to maximize his own value function 
over an admissible policy set C while the summation of all value functions is also maximized, 
i.e., 

(1.4) supl^“(0) = l^“*(0) 

uec 

for each I G {0,1,..., q}}, where. 


(1.5) 


<? 


Vo^{t) = Y,Vr{t). 


1=1 


Note that the total value function lo“(0) does not have to be a constant (e.g., zero), or in 
other words, the game is not necessarily a zero-sum one. 

The contribution and literature review of the study associated with the game in (jl.4p - (jl.5p 
for the third aim can be summarized as follows. One of the important solution methods for 
SDE based optimal control is the dynamic programming. In general, this method is related 
to a special case of the unified system in (II.ip (or its earlier unified B-SPDE form in Dai m 
(arxiv, 2011)), e.g., the specific B-SPDE with q = I (called stochastic HJB equation) in 
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Peng [H] with no jumps and 0ksendal et al. [H] with jumps. Here, we extend the discussions 
in Peng [H] and 0ksendal et al. [H] to a system of generalized coupled forward-backward 
oriented stochastic HJB equations with jumps corresponding to the case that q > 1. More 
importantly, this system provides an effective way to resolve a non-zero-sum SDG problem 
with jumps and general number of q players, which subjects to a non-Markovian system of 
coupled FB-SDEs with Levy jumps and skew reflections (see, e.g.. Figure [3] for such a game 
platform (partially adapted from Dai [E])). By a solution to the FB-SPDEs in (jl.lj) . we 



Policy 5 Made by Human Brain 5 


Brain-Satellite Tracking/Control and Dialogue System 


Call hims^ superman 


4 Made by Human Brain 4 


Figure 3: A 5-player game platform based on brain and satellite communication 


determine a solution to the FB-SDEs in (jl.3l) under a given control rule and then obtain 
a Pareto optimal Nash equilibrium policy process to the non-zero-sum SDG problem in 
dm). Note that, the concept and technique concerning the non-zero-sum SDG and Pareto 
optimality used in this paper is refined and generalized from Dai m and Karatzas and 

Li [n]. 

The fourth aim of the paper involves three folds. First,we study some queueing networks 
(see, e.g.. Figure [1|) whose dynamics (e.g., queue length process) is governed by specific 
forms of the FB-SDEs in (jl.3l) . These forms can be a Levy driven SDE, a p-dimensional 
reflecting Brownian motion (RBM) (see, e.g., Dai |14j . Dai and Dai [12], Dai and Jiang |21jL 
or a reflecting diffusion with regime switching (RDRS) (see, e.g., Dai |18] j. The reflecting 
diffusion is the functional limit of a sequence of physical queueing processes under diffusive 
scaling, a general completely-5 boundary reflection constraint, and a well-known heavy traffic 
condition (an analogous treatment as the one for “infinite constant” in the KPZ equation 
(see, e.g., Hairer |26])). In reality, the characteristics of Levy driven networks may be used 
to model or approximate more general batch-arrival and batch-service queueing networks. 
Second, we discuss how to use the queueing systems and their associated reflecting diffusion 
approximations to motivate the SDG problem. The criterion for the players in the game 
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Figure 4: A queueing network system with p-job classes 


can be the queue length based performance optimization ones or queueing related cost/profit 
optimization ones. Third, we study the applications of the FB-SPDEs presented by (HI) in 
the queueing networks. There are two types of equations involved. One is the Kolmogorov’s 
equation or Fokker-Planck’s formula oriented PDEs/SPDEs, which are corresponding to the 
distributions of queueing length processes under given network control rules. This type of 
equations are mainly used to estimate the performance measures of the queueing networks. 
Another type of equations are the HJB equation oriented PDES/SPDES, which are mainly 
used to obtain optimal control rules over the set of admissible strategies for the queueing 
networks. 

The remainder of the paper is organized as follows. In Section [2l we introduce suitable 
functional topological space and state conditions required for our main theorems to guarantee 
the well-posedness of an adapted 4-tuple strong solution to the unified system of coupled FB- 
SPDEs in (jl.ip . In Section [3l we study the unified system of coupled FB-SDEs with Levy 
jumps and skew reflections in (|1.3I) and present the well-posedness theorem. In particular, 
we establish the solution connection between the FB-SPDEs and the FB-SDEs. In Section [H 
we formally formulate the FB-SDEs based SGE problem in (jl.4h and determine the Pareto 
optimal Nash equilibrium policy process by a system of generalized stochastic HJB equations 
(a particular form of the coupled FB-SPDEs). Related applications in queueing networks are 
also discussed. Finally, in Sections [MZl we develop theory to prove our main theorems. 

2 The Unified System of Coupled FB-SPDEs with Levy Jumps 

First of all, let (D,T', P) be a fixed complete probability space. Then, we define a stan¬ 
dard d-dimensional Brownian motion W = {W{t),t G [0,r]} for a given T G [0,oo) with 
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W{t) = ...,Wd{t)y and a /i-dimensional general Levy pure jump process (or special 

subordinator) L = {L(t),t G [0,T]} with L(t) = (Li(t), ...,Lh{t))' on the space (see, e.g., Ap- 
plebaum [T], Bertoin [6], and Sato m)- Note that the prime appeared in this paper is used 
to denote the corresponding transpose of a matrix or a vector. Furthermore, W, L, and their 
components are supposed to be independent of each other. For each A = (Ai, ...Xh)' > 0, which 
is called a reversion rate vector in many applications, we let L(As) = (Li(Ais),..., L/j(A/is))'. 
Then, we denote a filtration by {Tt}t>o with Ft = a{G,W{s), L{Xs) : 0 < s < t} for each 
t G [0,r], where G is cr-algebra independent of W and L. In addition, let Ia{-) be the index 
function over the set A and ut for each i G {!,..., h} be a Levy measure. Then, we use 
A^j((0,t] X A) = to denote a Poisson random measure with a de¬ 

terministic, time-homogeneous intensity measure dsui{dzi). Thus, each Lj can be represented 
by (see, e.g.. Theorem 13.4 and Corollary 13.7 in pages 237 and 239 of Kallenberg m) 

(2.1) Li{t) = ai{t)+ I I ZiNi{Xids,dzi), t >0. 

J{o,t] Jz 

For convenience, we take the constant a* to be zero. 

In the subsequent two subsections, we hrst study the unified system in (jl.ll) . which is 
real-valued with a closed position parametric domain. Then, we extend the discussion to a 
complex-valued system with an open position parametric domain. 


2.1 The Real-Valued System with Closed Position Parametric Domain 


We let D G be a closed position parametric domain and use C^{D,R^) for each k £ Af 
and I G {r, g} to denote the Banach space of all functions / having continuous derivatives up 
to the order k with the uniform norm for each / in this space, 


( 2 . 2 ) 


\\f\\c>=(D,l) 


max max sup 


/. 


(c) 



The r(c) in (|2.2p for each c G {0,1,..., k} is the total number of the partial derivatives of the 
order c 


(2.3) 




dx^.. .dxy 


with ii G {0,1,..., c}, I G {1, r G {1,..., /}, and ii + ... + ip = c. Here, we remark that, 

whenever the partial derivative on the boundary dD is concerned, it is defined in a one-side 
manner. In addition, let 


(2.4) 

(2.5) 


f 

J I 


(c) 


* 1 , 


&\x) ^ 


(AG Ac) 

(x)). 


where each j G {l,...,r(c)} corresponds to a p-tuple {A,...,ip) and a r G {l,...,l}. Then, we 
use C°°{D,E!‘) to denote the Banach space 


( 2 . 6 ) 


C'°°(D,R') = i/G f|C‘=(D,R'),ll/llc-(A0 


c=0 
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where 


c =0 

for some discrete function ^(c) in terms of c € {0,1,2,...}, which is fast decaying in c. For 
convenience, we take ^(c) = 

r]{c) = [max{|xi| + ... + \xp\,x G D}]‘^, 


where the notation [] denotes the summation of the unity and the integer part of a real 
number. 

Next, let L'^{[0,T],C°^{D-, R^)) denote the set of all ii^-valued (or called C°°{D; R^)- 
valued) measurable random vector-held processes Z(t,x) adapted to {RtR G [0,T]} for each 
X G H, which are in C°°{D, R^) for each hxed t G [0, T]), such that 


( 2 . 8 ) 



2 

C^{D,l) 


dt 


< oo. 


In particular, let R^)) with I G {r,q} denote the set of all ii^-valued random 

vector-helds (^{x) that are ^/-measurable for each x G H and satisfy 


(2.9) 




= E 


Ico 




< OO, 


where = Q and Qq = Et- In addition, let Lp([0,T] x C°°{D, R^^^)) be the set 
of all i?^^^-valued random vector-held processes denoted by V{t,x,z) = {Vi{t,x, zi), ..., 
Vh{t,x, Zh)), which are predictable for each x £ D and 2: G and are endowed with the 
norm 


h 


( 2 . 10 ) 

Thus, we can dehne 


^ E / [ 

Li=i-io 


C°°{D,l) 


i'i{dzi)dt 


< 00. 


( 2 . 11 ) 


Finally, let 

( 2 . 12 ) 


Q3.([0,r] xH) = L^^{[0,T],C^{D,Rn) 

xL^([0,T],C°°(Ai?'')) 

xL%p{[0,T],C°-{D,R‘»<<^)) 


xLl{[0,T] X Z^,C°^{D,R‘>^'^)). 


7Xh\ 


Ll{Z^,C%D,R'i^^)) 


= \ v 


h « 

■.Z^^C‘^iD,R^^^), V / WUzi) 

^=l 


C-{D,q) ^dZi) < 00 
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that is endowed with the norm 


(2.13) 



Vi 




2 

C-{D,q) 


XiVi{dZi) 


for any v G and c G {0,1,oo}. Furthermore, dehne 


(2.14) 


V°^{D) = C^{D,BJ') 
xC°°{D,R‘i) 

xLl{Z'^,C°^{D,R‘^^^)). 


In the sequel, we let ||^|| be the largest absolute value of entries (or components) of the 
given matrix (or vector) A. Furthermore, for each s G [0,r] and z G Z^, we let 

(2.15) N{Xds,dz) = {Ni{Xids,dzi), ...,Nh{Xhds,dzh)y, 
where 

(2.16) Ni{Xids,dzi) = Ni{Xids,dzi) — Xidsvi{dzi) 


for each i G {l,...,h}. Then, we impose some conditions to guarantee the unique existence 
of an adapted 4-tuple strong solution to the unified system in mi)- 

First, for each A G {£,£, J", J"}, every c G {0,1,2,...,}, and any (tt*, u*, h*, h*) G V°°{D) 
with i G {1, 2}, we dehne 

A^^'^^(s, X, h^) 

= X, ,v^ ,v^ jV^) — “4*''^^(s, X, rt^, h^). 


Then, we assume that the generalized local Lipschitz condition is true almost surely (a.s.). 


(2.17) 


< 


^j^{c+l+o) (^s,x,u^,v^,v^,v^,u^,v‘^,v‘^,v'^) 

Kd,c “ '^^llc'=+'=(D,g) 

+ ||i;^ - v‘^\\ck+. 


^<^(D,qd) + 11^^ “ V^\\v,k+c 

Note that K^ f. in (I2.17P with each c G {0, 1,2,...} is a nonnegative constant. It depends on 
the domain D and the differential order c and may be unbounded as c —)• oo and D —)■ R^. 
I G {0,1,2} denotes the Ith order of partial derivative of x, u, v, v, v) in time variable 

t. o & {0,1,2} denotes the oth order of partial derivative of AA^^^’''){s,x,u,v,v,v) in terms 
of a component of u, v, v, or v. Furthermore, for each A G {1,1}, we suppose that 

(2.18) ^ f AA\''^''~^°\s,x,u^,v^,v^,v^,u'^,v‘^,v‘^,v‘^,Zi) Xiiziidzi) 


2=1 

< 


1 2ii2 111 2ii2 

U —u Ilcfc+c(£),r) 11'*^ “llc'=+'=(Z),g) 


V |lcfe+c(£)^grf) 


+ \\V^ -V^\\l,k+cl , 
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where Ai is the zth column of A. 

Second, for each A G {C, C, J', J'}, every c G {0,1,2,...,}, and any (n, n,h,h) G V°°{D), 
we suppose that the generalized local linear growth condition holds 


(2.19) 


^(c+Z+o)|-^^ X, U, V, V, v) 

< Kd,c (^^Oc + lkllc'=+‘:(D,r) + \\'^\\c*=+‘^(D,q) 
+ \\^\\c*=+^(D,qd) + ll^l|i/,A;+c] ; 


where, Jqc = 1 if c = 0 and Jqc = 0 if c > 0. Similarly, for each A G {X, X}, we suppose that 


( 2 . 20 ) 



J^c+l+o) 


{s,X,U,V,V,V,Zi) 


2 

Xiv{dzi) 



u 


2 

Ck+<^{D,r) 


2 

C*^+<^{D,q) 


+ 


||2 

\\C^+<^(D,qd) 


+ 


V 


||2 \ 
\\u,k-\-c j * 


Then, we can state our main theorem of this subsection as follows. 


Theorem 2.1 Suppose that {G,H) G Lg{^,C°°{D; R^)) x R'^)) and condi¬ 
tions in \2.1''/\) - li2.2(^) are true. Furthermore, assume that each A G is 

{Ft}-cidapted for every fixed x £ D, z £ Z^, and any given {u,v,v,v) G V°°{D) with 


(2.21) X(-,x,0) GL^([0,r],C°°(Ai?")), 

(2.22) J{; x, 0) G L^jr ([0, T],C°°{D, , 

(2.23) X(., X, 0, •) G ([0, T] x , 

(2.24) C{;x, 0) G L3. ([0, T],C^{D, R^)) , 

(2.25) J{;x, 0) G ([0, T],C^{D, , 

(2.26) X(-, X, 0, •) G X^r (^[0, T] x R^,C°°(B, R'^xh^j _ 

Then, there exists a unique adapted 4-tuple strong solution to the system in 031), ^.e., 


(2.27) 


{U,V,V,V) G Q^([0,T] xH), 


and {U,V){-, x) is cddldg for each x £ D almost surely (a.s.). 
The proof of Theorem 12.11 is provided in Section [5j 


2.2 The Complex-Valued System with Open Position Parametric Domain 

In this subsection, we generalize the study in Subsection 12.11 to the case corresponding to 
an open (or partially open) position parametric domain D (e.g., R^ or Rfifi). More exactly. 
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we assume that there exists a sequence of nondecreasing closed and connected sets {Dn,n G 
{0,1,...}} such that 

CX> 

(2.28) Z) = IJ 

n=0 

Furthermore, let C'°°(-D,C^) with I G {r,q} be the Banach space endowed with the norm for 
each / in the space 

OO 

(2-29) \\f\\c°°{D,l) = + ^)ll/llc°°(D„,0’ 

n=0 

where is the /-dimensional complex Euclidean space and the norm ||/|| in is 

interpreted in the corresponding complex-valued sense. In addition, define Qjr([0,r] x D) to 
be the corresponding space in (12.lip if the terminal time T is replaced by the stopping time 
r in dnD and the norm in (12.7p is substituted by the one in (I2.29p . Finally, we use the same 
way to interpret the spaces and C°°(D] W^)) . Then, we have the 

following theorem. 

Theorem 2.2 Suppose that {G,H) G L‘g{U.,C°°{D]BJ')) x R'^)) and the sys¬ 
tem in satisfies the conditions in Iji2. 17^ - 112.20\) over Dn for each n G {0,1,...} with 

associated (local) linear growth and Lipshitz constant Furthermore, assume that each 

A G is {Rt}-adapted for every fixed x £ D, z £ , and any given 

{u,v,v,v) G V°°{D) with conditions in I12.21\} - I12.26\) being true. Then, the system in lil.fil 
has a unique adapted 4-tuple strong solution 

(2.30) ([/,E,E,E) G Q3.([0,r] xD), 

and {U,V){-,x) is cddldg for each x £ D a.s. 

The proof of Theorem 12.21 is provided in Section [5l 

2.3 Illustrative Examples 

In this subsection, we present two illustrative examples related to heat diffusions and quantum 
Hall/anomalous Hall effects. Mathematically, the heat diffusions are modeled as a stochastic 
Dirichlet-Poisson problem and the Hall effects are presented by a stochastic Schrddinger 
equation. Examples related to queueing systems and SDGs will be presented in Section [3] 
after studying the system of coupled FB-SDEs in (II.3p . 

• Heat Diffusions: Stochastic Dirichlet-Poisson Problem 
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For this example, we consider a special B-SPDE (a specific backward part of the system 
in (11.11) 1. More precisely, the associated partial differential operators are given by 


C{t,x,U,V,V,V) 

J{t,x,U,V,V,V) 

i{t,x,u,v,v,v,z) 



d‘^V{t,x) 

dx] 


0 , 

0 , 


where V is single-dimensional (i.e., <? = 1) and g{t,x) is some integrable function. Then, we 
can obtain the corresponding B-SPDE with jumps as follows. 


(2.31) 


V{t,x) 



ds 


When the terminal value H(x) is a boundary based condition over D, we will call the related 
resolution problem a stochastic Dirichlet-Poisson problem with jumps, which is a randomized 
general form of the classical Dirichlet-Poisson problem (see, e.g., the definition of a classic 
case in 0ksendal [39]). An explanation about how to use this problem to estimate the inner 
or surface temperature of certain material or an object (e.g.. Sun) is displayed in Figure [5j 
Physically, the randomized heat equation in (|2.31l) is derived from a particle system just like 
its classic counterpart, which can be modeled by a diffusion process as follows, 


(2.32) dXt = b{Xt)dt + a{Xt)dW{t). 

Now, we use to denote the first exit time (a stopping time) of the process Xt from the 
time-space domain [0, T] x D, i.e., 

(2.33) rf) = inf{t > 0, {t, Xt) ^ [0, T] x D}, 

where the upper index x means that Xt starts from x € D. Then, we can impose a terminal¬ 
boundary condition with r = as follows, 

(2.34) lim V{t,Xt) = = Hd{x,u;) a.s. 

for all {t,x) G [0, T] x D. In the case that H£){x,u}) is a random variable independent of x, 
the required smooth condition for the well-posedness of the B-SPDE in (|2.31l) is satisfied. In 
general, Hij{x,uj) can be approximated by sufficiently smooth function in x as required. 


• Hall Effects: Stochastic Schrddinger Equation 
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To be determined, the 
inner heat value V(t,x) 


Measured boundary 
heat value H(x) 


Figure 5: A heat diffusion system by a solution to the Dirichlet-Poisson problem 


In quantum physics and statistical mechanics, some phenomena such as Hall/anomalous 
Hall effects (see, e.g., Hall [25], Karplus and Luttinger [32], and the summarized description 
at Wikipedia website) are major concerns. By the dehnition of Hall effect, the movements 
of quantum particles (e.g., electrons) within a semiconduct/superconduct are along regular 
paths (see Figure [6] for such an example) if the Lorentz force generated by an external 
magnetic field with a perpendicular component is imposed. When this phenomenon happens, 
the collisions of quantum particles will be significantly reduced and the performance of the 
semiconduct/superconduct will be largely improved. However, in a real application, imposing 
an external magnetic field is frequently expensive. Thus, people try to develop some magnetic 
material based semiconduct/superconduct in order that the Hall effect happens naturally (see, 
e.g., Karplus and Luttinger [32], Chang et al. HD]). This phenomenon is called anomalous 
Hall effect. 

Besides observing the Hall/anomalous Hall effects by physical experiments (see, e.g.. 
Hall [25] and Chang et al. [ID]), one can also analytically study and simulate these effects 
through a Schrddinger equation (see, e.g., Thouless [51], Chai [H] [9], and the summarized 
descriptions about density functional theory and time-dependent density functional theory 
at Wikipedia website). The Schrddinger equation used in most existing studies is a form of the 
Fokker-Planck’s formula (see, e.g., 0ksendal [39] )• Here, by taking a form of C in the forward 
part of the system in we can unify these Schrddinger equations (see, e.g., Bouard 

and Debussche [U [5], Thouless [5l], Chai [8] [9]) into the generalized stochastic nonlinear 
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Electrons move along edges (conducting) 



Figure 6: Edge states carry the current 


Schrodinger equation with absorbing boundaries for each i S {1, 2p}), 

(2.35) idV{t,x) = C{t~,x,V)dt + J'{t~,x,V)dW{t) + / I{t~,x,V, z)N{Xdt,dz), 

J 2>0 

where V is single-dimensional (i.e., q = 1), i is the imaginary number, and £ is a form of the 
operator, 

(2.36) C{t,x,V,-) = ^ajy(x) ^ + X] + c{x,V)V{t,x). 

j=i j j=i ^ 

Note that c{x, V) in (12.361) is the potential, which may depend on external temperature 
and/or external magnetic field. For example, the recent discovery about the Anomalous Hall 
Effect (see, e.g., Chang et al. [TO]) is based on a lower temperature and without imposing 
external magnetic field. Furthermore, the related Schrddinger equation based studies can be 
found in Chai [HI [9] , etc. 

Now, if the densities appeared in the Hall/Anomalous Hall Effects are the target station¬ 
ary distributions (i.e., the terminal values H{T,x) in (11.11) are given), we can take C in the 
system of (II.ip to be a form of the operator in (12.361) . Then, we can find the initial and tran¬ 
sient distributions of quantum particles by the backward part of the system in (II.ip . From 
physical viewpoint, this study provides insights about how to characterize and manufacture 
the magnetic material based semiconductor/superconduct. 
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3 The Coupled FB-SDEs with Levy Jumps and Skew Reflections 
3.1 The Coupled FB-SDEs and Its Well-Posedness 

In this section, we suppose that the process X governed by the forward SDE in (II.3p lives 
in a state space D (e.g., a p-dimensional positive orthant or a p-dimensional rectangle). 
Furthermore, let Dj = {x £ EP,x ■ rii = bi} for i £ {!,..., 6 } be the ith boundary face of 
D, where = 0 for i £ {!,...,p}, bi is some positive constant for i £ {p + 1,...,6}, and 
Hi is the inward unit normal vector on the boundary face Dj. For convenience, we define 
N = (ni,..., rift). In addition, let R in (II.3p he a p x b matrix with b £ {p,2p}, whose ith 
column denoted by p-dimensional vector Vi is the reflection direction of X on Dj. The process 
Y in (jl.3p is a nondecreasing predictable process with F(0) =0 and boundary regulating 
property as explained in (II.3p . In queueing system, this process is called boundary idle time 
or blocking process. 

Similarly, we assume that V takes value in a region D with boundary face Di = {v £ 
R'^,v ■ fii = bi} for i £ {1,..., 5}, where hj is the inward unit normal vector on the boundary 
face Di. For convenience, we define N = (ni,..., nj;). In finance, the given constant bi is 
called early exercise reward. Furthermore, S in (jl.3jl is supposed to be a g x 6 matrix for 
a known b £ {q,2q}. In addition, F(-) in ()1.3p is a nondecreasing predictable process with 
F(0) = 0 and boundary regulating property as explained in (jl.3p . 

To guarantee the existence and uniqueness of an adapted 6 -tuple weak solution to the 
coupled FB-SDEs in (II.3p . we need to introduce the completely-5 condition on the reflection 
matrix R (and similarly on S). 

Definition 3.1 A p x p square matrix R is called completely-S if and only if there is x > h 
such that Rx > 0 for each principal sub-matrix R of R, where the vector inequalities are to 
be interpreted componentwise. Furthermore, a p x b matrix R is called completely-S if and 
only if each p X p square sub-matrix of N'R is completely-S. 

Note that the completely-iS condition on the reflection matrices guarantees that the cou¬ 
pled FB-SDEs are of inward reflection on each boundary and corner of the orthant or the 
rectangle (see, e.g., Figure [2] and Dai [H]). Furthermore, the reflection appeared here is 
called skew reflection that is a generalization of the conventional mirror (or called symmetry) 
reflection. 

Now, the coefficient functions given in (jl.3p are assumed to be {J-)}-predictable and are 
detailed as follows. 


b{t, 

X 

u) 

= b{t, 

X 

V 

V, 

V, 

u, •) 

: [o,r] 

X 

RP 

X 

R^ 

X 

j^qxd 

X 

j^qxh 

X 

u 

-£ RP, 


a{t, 

X, 

u) 

= a{t, 

X 

V 

V, 

V, 

u, •) 
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X 

RP 

X 

R^ 

X 

Rqxd 

X 

Rqxh 

X 

U 

-£ RP^^ 


'n{t,x, 

u 

= 


V 

V 

V 

u 

•) 

: [o,r] 

X 

RP 

X 

R^ 

X 

j^qxd 

X 

j^qxh 

X 

U 

xZ^ ^ 

j^pxh 

c{t, 

X 

u) 

= c{t, 

X 

V, 

V, 

V, 

u, •) 

: [o,r] 

X 

RP 

X 

RP 

X 

j^qxd 

X 

Rqxh 

X 

U 

-£ RP, 


a{t, 

X, 

u) 

= a{t, 

X 

V 

V, 

V, 

u, •) 

: [0,r] 

X 

RP 

X 

RP 

X 

j^qxd 

X 

j^qxh 

X 

U 



C{t,x, 

< 


7(t,x, 

V 

V 

V 

u 

•) 

: [0,r] 

X 

RP 

X 

RP 

X 

j^qxd 

X 

j^qxh 

X 

U 

xZ^ ^ 

J^gxh 
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For /, /^, /^ G {b, a, c, a}, we suppose that 

(3.1) ll/(^i)ll < (1 + Ikll + ll^ll + ll^ll + ll'^D) 

(3.2) \\f{u) - f^{u)\\ < L(t,a;) (||x^-x^ll + llu^-u^ll 

+ ||^2_-1||^||~2_~1||J^ 

Furthermore, for each /, /^, /^ G { 7 , C} and 2 ; G Z^, we suppose that 

h „ 

(3.3) ^ / ||/i(M,2;i)f AiZ2j(d2;i) 

i=i 

< L^{t,uj) (^1 + ||x||^ + ||u|p + ||h|p + ||h||^^ , 

where /* is the ith column of /, and 
h „ 

(3-4) V/ \\ff{u,Zi) - fl{u,Zi)\\^ XiVi{dzi) 

i=i 

< L\t,u;) (||a;2 - xi||' + \\v‘^ - + \\v‘^ - + \\v‘^ - v^f^) . 

In addition, we assume that the terminal value H[x) = H{x, ■) satisfies the condition, 


(3.5) 


||iJ(x)|| < L{t,uj){l + ||x| 


Finally, L in (I3.1l) - (l3.4p and (13.51) is assumed to be a known non-negative stochastic process 
that is {J^f}-adapted and mean-squarely integrable, i.e., 


(3.6) 


E 


f 


L^{t)dt 


< 00. 


Theorem 3.1 Under conditions the following two claims are true: 

1. If S and R satisfy the eompletely-S condition, there exists a unique adapted 6-tuple 
weak solution to the system in lil.3\) when at least one of the forward and backward 
SDEs has reflection boundary; 

2. Furthermore, if each q x q sub-principal matrix of N'S and each p x p sub-principal 
matrix of N'R are invertible or if both of the SDEs have no reflection boundaries, there 
is a unique adapted 6-tuple strong solution to the system in lll.3\) . 

Due to the length, the proof of Theorem 13.11 is postponed to Section [H 
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3.2 Resolution via Coupled FB-SPDEs 


In this subsection, we consider a particular case of the coupled FB-SPDEs in (|l.ip but with 
an additional equation, which corresponds to the special forms of partial differential operators 
C, J, and X. More precisely, for each I G {0,l,...,g}, we define 


(3.7) Ci{t,x,U,V,V,V,u) 


*,i=i 

d p 


2=1 


i = l 


dVi{t,x) 

dxi 




j=ii=i 
h „ 


daij{t,x,u) 

dxi 


ci{t, x,u) + '^ sik(3k{t, x) 


k=l 

p 


I ( Vl{t,x + T]j(t,X,U,Zj)) - Vi{t,x) - ^ j VjidZj) 


i=i 

h 


2 = 1 


dxi 


+ Vjit,x,u,Zj)),u,Zj) - Cij{t,x,u,Zj)^ I'jidzj), 

j=i dz 

where rjij and r]j for i G {1, ...,p} and j G {1,..., h} are the (i, j)th entry and the jth column 
of r] respectively. Furthermore, 

<? 

(3.8) co{t,x,u) = '^ci{t,x,u), 


1=1 

g 


(3.9) 


Coj{t,X,U,Zj)) = '^Clj{t,X,U,Zj)), 


1=1 


and (ij for I G {!,...,g} and j G {!,...,/i} is the (z,j)th entry of (. In addition, 'yj{t,x) for 
j G {1,..., b} and f3k{t, x) for k G {1,..., q} are some functions in t and x. 

Note that, the partial derivative 


daij{t, X, u) 
dxi 


for each I G {0,1,..., g}, 




should be interpreted according to chain rule since a{t, x) is also a function in x through 
{V,V,V){t,x) and u{t,x), where 


(3.10) 

Finally, we define 


g 

aoj(t,x,u) = X, u). 

1=1 


(3.11) jit,x,U,V,V,V) = -V{t,x), 

(3.12) X{t,x,U,V,V,V,z) = -V{t,x), 

(3.13) V{T,x) = H{x), 

where, we assume that H G R'^)). Then, we have the following definition. 
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Definition 3.2 C is called the admissible set of adapted control processes if {Ci{t,x,U,V, 

V, V, u), I G {0,1,g}} together with {£, satisfy the conditions as stated in The- 

orem [Kl\ (or Theorem \2.2\) . 

Theorem 3.2 Let {U{t,x),V{t,x),V{t,x),V{t,x,-)) be the unique adapted 4-tuple strong 
solution to the {r, q+1)-dimensional coupled FB-SPDEs in which corresponds to specific 

in ^ - I13.12\) . terminal condition in i3.13\) . and a control process u & C. If S and 
R satisfy the completely-S condition, the following claims in are true: 

1. There exists a unique adapted 6-tuple weak solution {{X{t),Y(t)), (V (t), V (t), V{t, z),F{t))) 
to the system in lll.3\} when at least one of the SDEs has reflection boundary, where 

(3.14) Vflt) = Vi{t,X{t)), 

(3.15) Viflt) = - 

(3.16) Viflflz)) = -{Vi{t,X{t)+7^flt,X{t),u,zfl)-Vi{t,X{t))) 

-Cij{t,X{t) + r]j{t,X{t),u, Zj),u, Zj) 

for I G {0,1,..., g} and j G {1,..., h}, where 

(3.17) a{t,X{t),u) = a{t,X{t),V{t,Xit)),V{t,X{t)),V{t,X{t),-),u{t,X{t)),-), 

(3.18) r^{t,X{t),u) = r^{t,X{t),V{t,X{t)),V{t,X{t)),V{t,X{t)r),u{t,X{t)),-), 

(3.19) C{t,X{t),u) = C{t,X{t),V{t,X{t)),V{t,X{t)),V{t,X{t),-),u{t,X{t)),-); 

2. There is a unique adapted 6-tuple strong solution to the system in lll.3\} when each qx q 
sub-principal matrix of N'S and each p x p sub-principal matrix of N'R are invertible 
or when both of the SDEs have no reflection boundaries. 

4 Connections to Non-Zero-Sum SDGs and Queues 
4.1 Non-Zero-Sum SDGs 

By Theorem 13.21 we suppose that the 4-tuple {X, V,V,V) in ()4.1I) is part of a solution 
{X,Y,V,V ,V, F) to the non-Markvian system of coupled FB-SDEs with Levy jumps and 
skew reflections in ()1.3p . Then, let tt(-) be the corresponding B-valued {B C R‘^) and {Ft}- 
adapted control process, whose Zth component ufl-) for each I G {1, ■■■,q} is the Ith player’s 
control policy. Furthermore, we assume that the utility function for each player I G {1,..., g} 
is defined by 

ci{t, X{t),u) = ci{t, X{t), V{t, X{t)), V{t, X{t)), V{t, X{t)),u{t, X{t))), 

coit,X{t),u) = 

Thus, it follows from (I3.18p - (I3.19I) . (I3.9I) - (|3.10I) . and (14.ip that the value functions {V)“(0), I G 
{1, ...,g}} in (II.4h are now well defined. Then, we can introduce the following concepts. 



aij{t,X{t),u) + '^aii{t,X{t),'. 


2=1 


dxi J 
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Definition 4.1 By a non-zero-sum SDG to the system in U.3\) . we mean that each player 
I G {1,g} chooses an optimal policy to maximize his own value function expressed in (O- 
Furthermore, the value functions {VJ“(0),^ G do not have to add up to a constant 

(e.g., zero), or in other words, the SDG is not necessarily a zero-sum one. 

Definition 4.2 u*{-) is called a Pareto optimal Nash equilibrium policy process if, the process 
is also an optimal one to the sum of all the q players’ value functions at time zero; no player 
will profit by unilaterally changing his own policy when all the other players’ policies keep the 
same. Mathematically, 

(4.2) yo“*(0) > yo“(0), > vf-\Q) 

for each I G {0, 1, q} and any given admissible control policy u, where 

U-i = {ul, ...,U*g). 

Definition 4.3 {Ci{t,x,U,V,V,V,u),l G {0,1,g}} together with {C, J,X} are called sat¬ 
isfying the comparison principle in terms of u if, for any two u’' & C with i G {1,2} and any 
two Tt-" measurable W with associated two solutions {U’',V’',V’',V’'){t,x), respectively, of 
lll.3\) such that 

Ci{t,x,U\v\v\v\u^) < Ci{t,x,U^V^V^V^,u^), 

H\x) < H^{x) 


for all {t,x) G [0,T] X D, we have 


V^{t,x) < V‘^{t,x). 

Theorem 4.1 Let {U{t, x), V{t, x), V{t, x), V{t, x, •)) be the unique adapted f-tuple strong so¬ 
lution to the (r, q+l)-dimensional FB-SPDEs in which corresponds to specific {C, J 
in terminal condition in i3.13\) . and a control process u £ C. Suppose that S 

and R satisfy the completely-S condition. If {Ci{t,x,U,V,V,V,u),l G {0,1,. together 
with for suitably chosen 'y(t,x) and I3{t,x) satisfy the comparison principle in 

terms of u, the following two claims are true: 

1. There is a Pareto optimal Nash equilibrium point u*{t, X{t)) to the non-zero-sum SDG 
problem in Q when both of the SDEs in m.3\) have no reflection boundaries and if 
7 (t,x) = fl{t,x) = 0; 

2. There is an approximated Pareto optimal Nash equilibrium point u*{t,X{t)) to the non¬ 
zero-sum SDG problem in o when at least one of the SDEs in has reflection 

boundary and if^{t,x), I3{t,x) are taken to be infinitely smooth approximated functions 
of^(t,x) and ^{t,x) inx. 
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4.2 Queues and Reflecting Diffusions 


Queueing networks widely appear in real-world applications such as those in service, cloud 
computing, and communication systems. They typically consist of arrival processes, service 
processes, and buffer storages with certain kind of service regime and network architecture 
(see, e.g., an example with p-job classes in Figure [4]). The major performance measure for 
this system is the queue length process denoted by Q{-) = (Qi(-),..., (5p(-))', where Qi{t) is 
the number of ith class jobs stored in the ith buffer for each i G {1, at time t. Let (5(0) 
be the initial queue length for the system. Then, the queueing dynamics of the system can 
be presented by 


(4.3) 


Q{t) = Q{0) + A{t) - D{t), 


where, the ith component Ai{t) of A{t) for each i G {l,...,p} is the total number of jobs 
arrived to buffer i by time t, and the ith component Di{t) of D{t) is the total number of jobs 
departed from buffer i by time t. In the following discussions, we use two generalized ways 
to characterize the arrival and departure processes. 

First, we assume that each Ai{-) for i G {1, ...,p} is a time-inhomogeneous Levy process 
with intensity measure ai{t,Q{t), Zi)dtni{dzi) that is the job arrival rate to buffer i at time 
t and depends on the queue state at time t. Similarly, we assume that each Dj(-) is also a 
time-inhomogeneous Levy process with intensity measure di{t,Q{t), Zi)dtni{dzi) that is the 
assigned service rate to buffer i at time t. Furthermore, we assume that the routing proportion 
from buffer j to buffer i for jobs finishing service at buffer j is Pji{t, Q{t), Zj). Then, by the 
F-SDE in (11.31) and the discussions in Applebaum [T], the queue length process in (14.31) for 
this case can be further expressed by 


(4.4) dQi{t) = ( / ai{t,Q{t),Zi)ui{dzi) 




j¥^i ' 


+ 


di{t, Q{t), Zi)I{Q.^t)yoyUi{dzi)^ dt 
J ai{t,Q{t),Zi)Ni{dt,dzi) 


+ / Pjii^^Qit)^^j)dj{t,Q{i),Zj)I{Q.(t)>o}Nj{dt,dzj 


j¥^i ' 


di{t, Q{t), Zi)I{Q.^t)>o}Ni{dt, dzi) 


+ ^Rij{t,Q{t))dYj{t), 
i=i 

where, Z = Yj{t) in (14.41) for each j G {1,..., 6} is the Skorohod regulator process and it 
can increase only at time t when Qj{t) = 0. Note that R{t,Q{t)) is a reflection matrix that 


22 


may be time and queue state dependent, and the coefficients in (14.41) may be discontinuous 
at the queue state Qi{t) = 0. However, since the system in (14.41) is designed in a controllable 
manner, the service rate di{s, Q{s)) can always be set to be zero when Qi{t) = 0, which implies 
that the reflection part in (14.4p can be removed. Hence, the generalized Lipschitz and linear 
growth conditions in (j,‘l.ip - (j3.4p may be reasonably imposed to the system in (14.4p . Thus, 
the system derived in (|4.4p can be well-posed. Furthermore, the optimal policies in terms 
of cost, profit, and system performance can be designed and analyzed (see, e.g., the related 
illustration in the coming Subsection 14.3p . Interested readers can also find some specific 
formulations of the queueing system ()4.4p in Mandelbaum and Massey [36], Mandelbaum 
and Pats iSZj, and Konstantopoulos et al. [33], etc. 

Second, we assume that both the arrival and service processes are described by renewal 
processes, renewal reward processes, or doubly stochastic renewal processes. In this case, the 
driven processes for the queueing system do not have the nice statistical properties such as 
memoryless and stationary increment ones. Thus, it is usually impossible to conduct exact 
analysis concerning the distribution of Q{-). However, under certain conditions (e.g., the 
arrival rates close to the associated service rates), one can show that the corresponding se¬ 
quence of diffusion-scaled queue length processes converges in distribution to a p-dimensional 
reflecting Brownian motion (RBM) (see, e.g., Dai [14] . Dai and Dai [l2|, Dai and Jiang [21]). 
or more generally, a reflecting diffusion with regime switching (RDRS) (see, e.g., Dai [18]). 
In other words, we have that 

(4.5) Q^(-) = -Q{r^-) => Q{-) along r G {1, 2,...}, 

r 

where “=>” means “converges in distribution” and Q{-) is a RBM or a RDRS. 

To be simple, we consider the case that the limit Q{-) in (|4.5p is a RBM living in the 
state space D introduced in Section [3| Furthermore, let 0 be a vector in RP and T he a p x p 
symmetric and positive definite matrix. Then, we can introduce the definition of a RBM 
(see, e.g, Dai M) as follows. 

Definition 4.4 A semimartingale RBM associated with the data (S,0,F,i?) that has initial 
distribution n is a continuous, {J-t}- 0 'dapted, p-dimensional process Z defined on some filtered 
probability space (H, {J't}, P) such that under R, 

X{t) = Z{t) + RY{t) for all t > 0, 


where 

1. X has continuous paths in S, P-a.s., 

2. under P, Z is a p-dimensional Brownian motion with drift vector 9 and covariance 
matrix T such that {Z{t) — 6t,Ftfi > 0} is a martingale and PZ~^{ff) = vr, 

3. Y is a {Ft}-adapted, b-dimensional process such that P-a.s., for each i G {1, ■■■,b}, the 
ith component Yi of Y satisfies 
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(a) yj(0) = 0, 

(b) Yi is continuous and non-decreasing, 

(c) Yi can increase only when Z is on the face Di, i.e., as given in UM- 

From the physical viewpoint of queueing system (see, e.g., Dai mm) and the discussion 
in Reiman and Williams [47], the pushing process Y in Definition 14.41 can be assumed to a.s. 
satisfy 

(4.6) Y,{t)= f In,{X{s))ds. 

Jo 

Now, assume that H{x) is the stationary distribution that we expect for the RBM X. For 
example, in reality, it is the given distribution of the long-run average queue lengths among 
different users or job classes. Theoretically, it can be computed by a method (e.g., the finite 
element method designed and implemented in Dai et al. [141149] i. Then, we can use a B-PDE 
or a B-SPDE (a special form of the system in (ll.ip i to get the transition function at each 
time point to reach the targeted or limiting stationary distribution H(x) for the RBM X for 
a given initial distribution (e.g., X(0) =0 a.s. in many situations). Hence, the corresponding 
performance measures of the physical queueing system can be estimated. More precisely, we 
have the following theorem and related remark. 

Theorem 4.2 Suppose that the reflection matrix satisfies the completely-S condition. Then, 
the transition function of the RBM X over [0, T] is determined by 

(4.7) V{t,x) = H{x)-\- £{s,x,V)ds, 

where V is a 1-dimensional function. Furthermore, C is the following form of partial differ¬ 
ential operator 

(4.8) C{t,x,V,-) = {}C{t,x,V,-),Vi{t,x,V,-),...,Vb{t,x,V,-)), 

(4.9) JC{t,x,V,-) = ^Ti,^^^ + e-^V{t,x) + ^Vflt,x,Vr), 

i,j=l * ^ i=l 

(4.10) 'Di{t,x,V,-) = {vi-\/V{t,x))lDi{x) for X ^ Di with i ^ {I, ...,h}, 

where \jV is the gradient vector of V in x and Ipi is the indicator function over the set Fi. 

Proof. R follows from the completely-5 condition that the RBM X is a strong Markov 
process (see, e.g., Dai and Williams m)- Then, by applying the Ro’s formula (see, e.g., Prot- 
ter m) and Eokker-Planck’s formula (or called Kolmogorov’s forward/backward equations, 
see, e.g., 0ksendal [39|), we know that the claim stated in the theorem is true. □ 

Remark 4.1 Owing to the uncertainty error of measurement, H{x) could be random. Fur¬ 
thermore, the coefficients in |.^.g| ) may also be random, e.g., for the case that the limit Qf) 
is a RDRS. Thus, a B-SPDE can be introduced. Furthermore, the indicator function Ipiix) 
can be approximated by a sufficient smooth function in order to apply Theorem \2.1\ to the 
equation in which is reasonable from the viewpoint of numerical computation. 
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4.3 Queueing Based Game Problem 


From the information system displayed in Figures [3][1] (presenting a parallel-server queueing 
system with q = p), we can give an explanation about the decision process for such a game 
problem. In this game, each player (or called user in Dai [18]) relates to a control process 
ui{-) for I G {1, ...,q} over certain resource pool (e.g., called the transmission rate allocation 
process over a randomly evolving capacity region in Dai |18]). In the meanwhile, each player I 
is assigned a surrogate utility function ci of his submitted bid (called queue length in Dai [T8] . 
or the approximated queue length RBM Z in Definition I4.4|l to the network, the price from 
the network to him, and the control policy at each time point by the central information 
administrative. Then, an optimal and/or fair control process can be determined by the 
utility functions of all players, queueing process, and the available resource constraint in a 
cooperative way (see, e.g., Jones ESI). 

5 Proofs of Theorem 12.11 and Theorem 12.21 

We justify the two theorems by first proving three lemmas in the following subsection. 


5.1 The Lemmas 


Lemma 5.1 Assume that the conditions in Theorem \2.1\ hold and take a quadruplet for each 
fixed X ^ D and z G Z^, 

(5.1) {U^{;X),V^;X),V\;X),VH;X,Z)) G QmO,T] X D). 

Then, there exists another quadruplet {U‘^{-,x),V‘^{-,x),V'^{-,x),V'^{-,x, z)) such that 

' U^{t,x) =G{x) + jQC{s-,x,U^,V\V\V^)ds 
+ j/;j{s-,x,U\V\V\V^)dW{s) 

+ /o X{s-,x,U\V\V\ V\z)N{Xds, dz), 

V^{t,x) =H{x) + C{s-,x,U^,V^,V^,V^)ds 

( 5 - 2 ) +J^(^J{s-,x,U\V\V\V^) 

+V^{s-,x) - V^{s-,x)) dW{s) 

+ (^(s-,x,UfiV\V\V\z} 

+V^(s~, X, z) — V^(s~, X, z)'j N{Xds,dz), 

where (C/^, P^) is a {Ft}-adapted cddldg process and (P^, P^) is the corresponding predictable 
process. Furthermore, for each x £ D, 


(5.3) 

E 

(5.4) 

E 


f \\U‘^{t,x)\\‘^dt 
Jo 

r\\v\t,x)fdt 

Jo 


< oo. 


< oo. 
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< oo 


(5.5) 

E 

(5.6) 

E 

Proof. 

For each fixed x G 

(l2Tn)-(l2 

26P that 

(5.7) 

C{-,x,U 

(5.8) 

J{-,x,U 

(5.9) 

X(-,x,C/’ 

(5.10) 

C{-,x,U 

(5.11) 

j{-,x,U 

(5.12) 

Z{-,x,U^ 


x)\\‘^dt 


[f 

h i-T r 

^IL 


V^{t,x,Zi) Vi{dzi)dt 


< oo. 


- T/l T>1 T>l^ 


'2 / 


yrxd 


)), 


?rx/i 


)), 


7Xd\ 


7 X/l\ 


By considering £, J", and I in ()5.7p - ()5.9p as new starting £(•,x,0,0,0,0), J7(-,x,0,0,0,0), 
and X(-, X, 0,0,0,0), we can define U'^ by the forward iteration in p5.2p . Furthermore, U'^ is 
a {J^t}-adapted cadlag process that is square-integrable for each x € Z7 in the sense of (15.3p . 

Now, consider C, j^ andX in p5.10l) - p5.12p as new starting £(•, x, 0,0,0,0), j (•, x, 0,0,0,0), 
and XP',X, 0,0,0,0). Then, it follows from the Martingale representation theorem (see, e.g.. 
Theorem 5.3.5 in page 266 of Applebaum P) that there are unique predictable processes 
V'^{-,x) and V'^{-,x,z) such that 


(5.13) 


V'^{t,x) 


= E 


H{x)+ / C{s-,x,U\V\V\V^)ds 
70 

T 


Tt 


+ J (j(s-, X, U\ V^) + V\s-,x)^ dW{s) 

+ j (i{s~,x,U^,V^,V^,V^,z) + V^{s-,x,z)^ N{Xds,dz) 

= V^{ 0 ,x)+ [ V^{s-,x)dW{s) + [ [ V‘^{s-,x,z)N{Xds,dz). 

Jo Jo Jz 

Furthermore, and are square-integrable for each x G 17 in the sense of p5.5h - (l5.6p . and 
(5.14) 1^2(0, x) 

= V^{T,x)- [ V^{s-,x)dW{s) - [ [ V^{s-,x,z)N{Xds,dz) 

Jo Jo Jz 

fT _ 

= H{x)+ / C{s-,x,u\v\v^,v^)ds 

Jo 


+ 


s-,x,U^,V^,V^,V^) + V^{s-,x) - V’^{s-,x)] dW{s) 


2/ - 
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+ J j [x{s , X ^ z) + {s ,x,z) — V‘^(s , x, z)^ N {Xds, dz). 


Owing to the corollary in page 8 of Protter [36], V'^{-,x) can be taken as a cadlag process. 
Now, define a process V‘^ given by 

(5.15) V‘^{t,x) = E H{x) + j^ £{s-,x,U\v\v\V^)ds 

+ {j{s-,x, V\V^) + P^(s-, x)) dW{s) 

/.T « 

(T{s~,x,U^,V^,z) + V^{s~^x^z'^ N{\ds,dz) 


+ 


n JZ 


Ft 


Thus, it follows from (|2.19l) - (l2.20p and simple calculation that V‘^(-,x) is square-integrable 
in the sense of ()5.4p . In addition, by (I5.13p - (|5.15l) . we know that 


(5.16) V^{t,x) 


V‘^{t,x) 



x,U^,V^,V^,V^)ds 



,x, U\V^,V^,V^) + -pHs", x)) dW{s) 
s~,x, U^,V^,z) + P^(s“, X, z)^ N{Xds, dz), 


which implies that V‘^(-,x) is a cadlag process. 

Hence, for a given quadruplet in (|5.1I) . it follows from (|5.13l) - (|5.14p and (|5.16l) that the 
associated quadruplet (t/^(-,x), H^(-,x), P^(-,x), V'^{-,x,z)) satisfies the equation p5.2p as 
stated in the lemma. Furthermore, we know that 


(5.17) V^{t,x) 


= V'^{0,x)- [ C{s-,x,U\V\V\V'^)ds 
Jo 

tI ttI f>l ^7l^ I T>2/^— 


^ (^J{s-,x,U\V\V\V^) + V\s-,x)-V^{s-,x)j dW{s) 

(l{s~,x, U^,V^, V~, V^, z) + V^{s~,x, z) — V‘^{s~,x, z)'j N{Xds, dz). 


0 JZ 


Thus, we complete the proof of Lemma l5.11 □ 


Lemma 5.2 Under the conditions of Theorem \2.1[ consider a quadruplet as in 115.1\) for 
each fixed x € D and z G Z^. Define {U{t,x),V{t,x),V{t,x),V{t,x,z)) by i5.2\) . Then, 
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V^‘^\-,x), V^^\-,x), V^^\-,x, z)) for each c € {0,1,...,} exists a.s. and satisfies 


(5.18) 


' ui:L^t,x) 


x) = H^>{x) + f^£l:r(s-,x, U\V\ V\ V^)ds 


= + fo = G\V\V\ V^)ds 

+ fo (s-,^,U\V\V\V^)dW(s} 

+ fofz^it^J^~’^’G\V\V\V\z)N(^ds,dz), 


r(c) 


T Me) 


2 . 1 .. . 2 p ' 


2.1 • • • tp 


2i. ,,tp ' 


+ lI'{jhUi‘Zx,U',V\V\V') 


,x,z)] N{\ds,dz), 


z{c) 


where ii + ... + ip = c and ii G {0,1,..., c} with I G {1, ...,p}. Furthermore, {uf'^ 

for each c G {0,1,...} is a {iFt}-adapted eddldg process and is the associated 

predictable processes. All of them are squarely-integrable in the senses of 

Proof. Without loss of generality, we only consider the point x £ D, which is an interior 
one of D. Otherwise, we can use the corresponding derivative in a one-side manner to replace 
the one in the following proof. 

First, we show that the claim in the lemma is true for c = 1. To do so, for each given 
t £ [0,T],x G D, z G Z^, and {U^{t, x), V^{t, x), V^{t, x), V^{t, x, z)) as in the lemma, let 

(5.19) {U^l\t,x),V^^\t,x),vl;^\t,x),vl;^\t,x,z)) 

be defined by (15.21) but each A £ {C,J,X,C.,J,X] is replaced by its first-order partial 
derivative 


G 


7- 

‘-'H 


( 1 ) -jA) rA) erA) -jA) 

Ml ■’^il ■>^il Mil 


with respect to x; for I £ {1, ...,p} if i; = 1. Then, we can show that the quadruplet defined 
in (j5.19j) for each I is the required first-order partial derivative of {U,V,V,V) in (15.2j) for the 
given {U^,V^,V^,V^). 

In fact, considering an interior point x of D, we can take sufficiently small constant 
5 such that x + 5ei £ D, where e; is the unit vector whose Ith component is one and 
others are zero. Without loss of generality, we assume that d > 0. Then, for each / G 
[U, V, V, V, U^,V^, V^, V^} and ii = I with I £ {1, ...,p}, we define 


(5.20) 


fii,5{t,x) = f{t,x + Sei). 


Furthermore, let 

(5.21) 




^s{t,x)-f{t,x) 
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and let 


(5.22) 


AA^l{t,x,U\V\V\V^) 

^ (^A{t, X + 6ei,U^{t, X + 6ei), V^{t, x + 5ei), V^{t, x + 5ei), V^{t, x + de[,z)) 
—A{t, X, U^{s, x), V^{t, x), V^{t, x), V^(t, X, z))^ 

-A^^^t, X, U^(s, x), V^(t, x), V^(t, x), V\t, X, z)} 



Now, let Tr(A) denote the trace of the matrix A'A for a given matrix A and let (Tr(A))j 
be the jth term in the summation of the trace. Furthermore, for each fixed t G [0, T] ,6>0, 
and 7 > 0, define 


(5.23) Zs{t,x) = 

= +Tv(Ay“((,!)))<!"’•. 

Then, it follows from (|5.17l) and the ltd’s formula (see, e.g.. Theorem 1.14 and Theorem 1.16 
in pages 6-9 of 0ksendal and Sulem [lO]) that 


f-T 

(5.24) Z,{t,x) + Trl^Aj^^^lis-,x,U\V\V\V^) 


h 

+E 


i=i 



t Jz 


Tr(ATl^l{s-,x,U\v\v\v\z) 


= 2 


(- 7 Tr(A[/W(s,x)) + [aU^^x])'[aC^I{s,x,U\v\v\V^))'^ e^^^ds 

(-7Tr (AyW(s,x)) + (AyW(s,x))' {ACf^,{s,x,U\V\V\V^))^ e^^^ds 
-Ms{t,x) 

i: 
i: 


+2 


< - 


+7 


+7 


AC^^,{s,x,U\V^,V\V^) 


aj:^\{s,x,u\v\v\v^) 


1 jA T>1 T71^ 






-Ms{t,x) 


= 7 


AC^l{s,x,U\V\V^,V^) 


‘ e'^'^^ds 
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+7 


r 


aj:^\{s,x,u\v\v\v^) 


1 jA f>l T7l^ 




7 = — > 0 . 
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-Ms{t,x) 

if, in the last equality, we take 

(5.25) 

Note that Ms{t,x) in (|5.24|) is a martingale of the form, 

(5.26) Ms{t,x) 



-^M{s-,x,u\v\v\v^) 


h 

+2E 

i=i 


+A(7)™(»-,x) - A(F,)5 (»-,i)) e^-'‘dWiis) 

j ds^ ) • 


,x 


+ ,X,Zj) - A(yj)*y5(s ,X,Zj 


Thus, by the martingale property and (j5.24|) . we know that 

l-T 

(5.27) E ' 


Zs{t,x) + I Tr(Aj}^lis-,x,U\v\v\V^) 


h 

+E 


i=i' 



t Jz 


Tr(A2|'J(s-,x,C/\W,y\ySz) 


,x,z)\] e^'^^Nj{\jds,dzj) 


< 


+7 


A£^(s,a;,C/^y^F^y^) 


4,<5 

1 T^l f7l ^>l^ 


/ 

J^'^\\AC^^,is,x,U\V\V\V^) 


' e^'^^ds 


' e^'^^ds 


Furthermore, by (I5.24p - (l5.27p and the Burkholder-Davis-Gundy’s inequality (see, e.g.. The¬ 
orem 48 in page 193 of Protter [46j 1. we have the following observation. 


(5.28) 


E 


sup \Ms{t,x)\ 

0<t<T 
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[/ 


<jKiE I AC^l{s,x,U\V^,V\V^) 


+^Ki 


A4')(5,x,c/^y^F^y^) 


' e^'^^ds 


‘ e^'^^ds 


where Ki is some nonnegative constant depending only on K^fi, Ko,i, T, and d. Note 
that, the detailed estimation procedure for the quantity on the right-hand side of (|5.28p is 
postponed to the same argument used for ()5.55p in the proof of Lemma 15.31 since more exact 
calculations are required there. 

Next, for each fixed t £ [0, T], x G D, and cj > 0, consider the random variable set 
{Zs{t,x), 6 G [0, cj]}. It follows from Lemma 1.3 in pages 6-7 of Peskir and Shiryaev [13] that 
there is a countable subset C = {(5i, ( 52 ; ■■•} C [0, a] such that 


(5.29) 


esssup 5 g[o,< 7 ]^< 5 (^)a;) = supZs{t,x), a.s.. 


Zs^{t,x) = Zs^{t,x), 

Zs^^^{t,x) = Zs^{t,x)y Zs^^^{t,x) for nG{l, 2 ,...}, 


where “esssup” denotes the essential supremum. Furthermore, take 

(5.30) 

where a V /3 = max{a, /3} for any two real numbers a and (5. Obviously, 

(5.31) 


Zs{t,x) < Zs{t,x) for each <5 G C 

Zsj^{t,x) < Zs 2 {t,x) for any 5 i ,52 G C satisfying 5i < 62 - 


The second inequality in p5.31l) implies that the set {.^^(t, x), 5 G C} is upwards directed. 
Hence, for each t G [0, T], x G D, a > 0, and the associated sequence of {Snjn, = 1,2,...}, it 
follows from (I5.29P that 


(5.32) 


E [esssupo<5<^2'5(t,x)] 
< F; [esssup5gc^5(^>a:)] 

= lim E [Zs„ {t, x)] 


= lim E 

n —>00 


max Zs(t,x) 
5g{5i.....<5„} 


In addition, for each fixed n G {2,3,...}, let 
(5.33) 

Thus, by the induction method in terms of n G {1, 2,...} and (|5.24p . we know that 


(5.34) E 


max Zs(t,x) 
.<5e{5i,...,<5n} 


< 7 lim E 

n^oo 


I 


max 
0 


A£^\{s,x,U\V\V\V^) 


1 T/l T71^ 
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+ 


/ 


max 

t 5G{Si,...,Sn} 


AC^^,{s,x,U\V\V\V^) 




- lim E [M 5 „ (t, x)] 


< KE 


[f 


esssupo<5<o 


a6^\{s,x,U^,V\V\V^) 


1 T^l f>l T71^ 




+ J esssupo<5<o 

rT 


L 


+ / esssupo<5<o 


ACf^,{s,x,U\V\V\V^) 

AJ^%-,X,U\V\V\V^) 


' e^^^ds 


e^^^ds 


rT h 

^ I ®®®®^P 0 < 5 <o 


10 .^^JZ 


e^'^^XiVi{dzi)ds 


where K \s a, nonnegative constant depending only on d, T, and 7 . Note that, in the 

second inequality, we have used the fact in (j5.27l) and the following observation 

(5.35) \E [MsAi,x)] \ < E [sup^gjo^r] \\Ms„it,x)\\ \ + £" [supjg[o,T] \\Ms^-iit,x) 


Now, recall the condition that 


{U^i;x),V^;x),V\;x),VH;X,z)) £ QM[ 0 >^] >< D). 


Then, for each x & D, z & Z^, any c G {0,1,...}, and any small number ^ such that 
X + G D, we have that 

(5.36) X + ^ei), X + ^e/), x + ^ei), yhW(t, x + Cei,z)) 


< 


(max U^’^'^\t,x) 
\xeD 


, max 
x&D 


y^’(=)(t,x) 


, max 

xGD 




, max 
x£D 


t7hW(t,x,2) 


Note that the related quantities on the right-hand side of (|5.36l) are squarely integrable a.s. in 
term of the Lebesgue measure and/or the Levy measure. Therefore, {t, x, •) (the integration 
of V^{t,x,z) with respect to the Levy measure) is also infinitely smooth in each x € D due 
to the Lebesgue’s dominated convergence theorem. Thus, by the mean-value theorem, there 
exist some constants .^1 G (0,(5) and ^ G (0,^i), which depend on 5, such that 

(5.37) AA^}{t,x,U\V\V\V^) 

= X + ^ei, U^{t, X + Cei), V^{t, x + ^ei), V^{t, x + ^ei), V^(t, x + ^ei, •)) 

a.s. for each A G {jC,J',jC}. Due to (|5.37l) . (12.1711 . and (|5.36l) . the quantity on the left-hand 
side of (I5.37P for all 5 is dominated by a squarely-integrable random variable in terms of the 
product measure dt x dP. Similarly, for = ^7 and each G Z^, we a.s. have that 

(5.38) AA^^sit^x,U\v\v\v\z) 

= ^iA\^\t, X + ^ei, U^{t, X + ^ei), V^{t, x + ^ei), V^{t, x + ^ei), V^{t, x + ^ei, z), z). 
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Owing to (I5.37p . (|2.18p . and (15.361) . the quantity on the left-hand side of (|5.38l) for all 6 
is dominated by a squarely-integrable random variable in terms of the product measure 
dt X u{dz) X dP. Therefore, it follows from (|5.32p - (l5.34p and the Lebesgue’s dominated 
convergence theorem that 


(5.39) lim resssupo<5<o-^5(Ta;)] 

cr—^O — — 


< KE 


■ /■* 

/ lim 

Jo 


Im esssupo< 5 <^ x, U\V\ Vj 

+ I lini esssupo<5<^ x, 


CT —>-0 


2 


-h / lim esssupo<5<o 
Jo - 

pT h „ 

+ / XI / li™esssupo<5<c 
Jo ^ Jz '^-^0 




e^^^ds 

e^'^^ds 


AxR(s ,x,U^,V^,V^,V^,Zi) e'^'^^XiUi{dzi)ds 


"hJ 


Hence, by p5.39p and the Fatou’s lemma, we know that, for any sequence an satisfying c7„ —)• 0 
along n € A7, there is a subsequence A7' C A7 such that 


(5.40) 


esssupo< 5 <o-„-^ 5 (ij 2 ^)) —^ 0 along n G J\f' a.s. 


The convergence in (I5.40p implies that the first-order derivatives of U and V in terms of xi for 
each I S {l,...,p} exists. More exactly, they equal U-^\t,x) and V^^\t,x) a.s. respectively 
for each t € [0,T] and x G D. Furthermore, they are {J-i}-adapted. 

Now, we prove the claim for V. In fact, it follows from the proof as in (I5.32p - (j5.34l) that 

(5.41) ^ 


lim E 

( 7 — >0 


esssupo< 5 <^Tr x, U^,V^,V^,Vj 


+A(Hi)g(s,a;) - AH.J^j(s,x)) 


( 1 )/ 


is also bounded by the quantity on the right-hand side of (j5.39ll . Thus, by (j5.40l) and ^5.411) . 
we know that 


= linr (a X,U\V\V\VJ + x)) 

= 0, a.s. 

Hence, the first-order derivative of V in xi for each I G {1, exists and equals vJ\t,x) 
a.s. for every t G [0,r] and x G D. Furthermore, it is a {J-)}-predictable process. Similarly, 
we can get the conclusion for V^^\t,x, z) associated with each I, t, x, and z. 

Second, we suppose that x), x), x), x, z)) correspond¬ 

ing to a given {U^{t,x), V^{t,x), V^{t,x), V^{t,x,z)) G Q3^([0,T] x D) exists for any given 
c e {1, 2,...}. Then, we can show that 

(5.42) (t, x), (t, x), (t, x), HW (t, x,z)) 
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exists for the given c G {1,2,...}. 

In fact, consider any fixed nonnegative integer numbers ii,..., ip satisfying ii+...+ip = c—1 
for the given c G {1,2,...}. Take / G {U, V,V,V}, I G {1, and sufficiently small <5 > 0. 

Then, let 

( 5 - 43 ) = fiZt ^ 

correspond to the (c — l)th-order partial derivative (s, x + 5ei, U^{s, x + dei), x + 

6ei)) of ^ G {C,J^,X,C,S,T} via (|5.2p . Similarly, let 

■ (t,x,z)) 

be defined by (j5.2h . where A G are replaced by their cth-order partial 

derivatives A^^^ (ij+i) i corresponding to a given t,x, U^(t,x), x), V^{t,x), V^(t,x,z). 

Furthermore, let 


(5.44) 


(o) _ (o) . , 


for each / G {17, V, y, y, [/^ V^}. Then, define 

(5-45) 

= (A[''~]^^{t,x + dei,U^{t,x + 6ei^ - V^{t,x + dei),-) 

- Atip(«> a;, {s, x), V^is, x)-)) 

-Av..(i,+i)...ipa:)-) 

for each A G {C, J',1, C, ,T}. Thus, by the ltd’s formula and repeating the procedure as 
used in the first step, we know that 

■ (t,x),V.^‘^\. .s ■ {t,x),V.^^\. .s ■ (t,x,z)) 

exist for the given c G {1,2,...} and all I G {1, Therefore, the claim in ()5.42D is true. 

Third, by the induction method with respect to c G {1,2,...} and the continuity of all 
partial derivatives in terms of x G H, we know that the claims in the lemma are true. Hence, 
we hnish the proof of Lemma 15.21 □ 


To state and prove the next lemma, let Djr{[0,T],C°°{D, R^)) with I G {r,q} be the set 
of ii^valued {T}}-adapted and squarely integrable cadlag processes as in (|2.8I) . Furthermore, 
for any given number sequence 7 = { 7 c,c = 0,1,2,...} with 7 c G 7?, define A4;^[0,T] to be 
the following Banach space (see, e.g., the related explanation in Yong and Zhou [52], and 
Situ [50] 1 

(5.46) M^[Q,T] = D^([0,r],C°°(Il,72n) 

xZl3.([0,r],C°°(Zl,i7‘^)) 
xL2.p([0,r],C-(Il,i7'?x'')) 
xL2([0,r] X 
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which is endowed with the norm 


(5.47) 


iU,V,V,V) = £e(c) {U,V,V,V) 


c=0 


Tc.c 


for any given (U, V, V, V) G A4:r [0, T], and 


(5.48) 


{U,V,V,V) 




= E 


sup \\U{t)fc-,j^ se 
0<t<T 


2'yct 


+E 

+E 

+E 


sup ll^(i)llc=(D,5)e^^"* 

0<t<T 

Jo 

r\\v{t) 

Jo 


C<^{D,qd) 
2 




Then, we have the following lemma. 

Lemma 5.3 Under the conditions of Theorem \2.1l all the claims in the theorem are true. 

Proof. By (15.2p . we can define the following map 

H : {U\-,x),V^{-,x),V^{-,x),V\-,x,z)) {U{-,x),V{-,x),V{-,x),V{-,x, z)). 

Then, we show that H forms a contraction mapping in A4;^[0, T]. In fact, consider 

{U\;x),V\;x),V\;x),V\;X,z))gM^[0,T] 

for each i G {1,2,...}, satisfying 

{W^\;x), V^+\;X), V^+H;X), V^+H;X, z)) 

= E{W{;X),V\;X),V\;X),V\;X,Z)). 


Furthermore, define 


Ar = r+'-r with fe{u,v,v,v} 


and take 


(5.49) C{^U\t, x) + AV\t, x)) = (Tr {AU\t, x)) + Tr {AV\t, x))) 

Thus, it follows from ()2.17p and the similar argument as used in proving (I5.24p that, for a 
7o > 0 and each i G {2,3,...}, 

(5.50) C{AU\t,x) + AV\t,x)) 
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+AV^-\s,x) - AV^{s,x)) e^^°^ds 

h rT r 

+ YlJ^ J (Tr 


+AV^-\s-,x,z) - AV\s-,x,z))) e^^°^Nj{Xjds,dzj) 

2 


< % 


+ 


AC{s, X, U\ V\ V\ V\ 






A£(s, X, U\ V\ V\ V\ U^-\ V^-\ V^-\ V^-^) 

-M\t,x) 

< %Ka,oN^-\t)-M\t,x), 

where i^a,o is some nonnegative constant depending only on K^^q. For the last inequality in 
(j5.5np . we have taken 


70 = > 0. 

270 


(5.51) 

Furthermore, appeared in (|5.50l) is given by 

(5.52) N^-\t) 


lc'=(D,r) 


S^T'O'ds 


= / \\^U-\s)\\ 

Jo 

In addition, M'^{t,x) in (I5.50p is a martingale of the form, 

(5.53) M\t,x) = 

-2^ f [AU\s-,x))' 

,= 1^0 


Ar-^(s) 


u.k 




AJj(s-,x, U\V\V\V\ C/*-\ y*-^)e2T'"dkFj(s) 


h ft 


/ / (AC/'(5-,x))' 
^do Jz 


AIj{s-,x, U\ V\ V\ V\ W-\V^-\V^-\V^-\zj)e^^^Nj{Xjds, dzj) 


d 


+2E / {^y\s-,x)y (^Ajj{s-,x,U\V\V\V\W-\V^-\V^-\V^-^) 
1=1 

+{AV^-yj{s-,x) - {AVyj{s-,x)) e^^°^dWj{s) 
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h 


+ 2 E/ l^{{AV^)j{s-,x)y (^Ai,{s-,x,U\V\V\V\W-\V^-\V^-\V^-\zj) 

+{AV'^~^)j{s~,x, Zj) — {AV^)j{s~,x, Zj)J e^'^°^Nj{Xjds,dzj). 

Then, it follows from (I5.50l) - (|5.53l) and the martingale properties related to the ltd’s stochastic 
integral that 

(5.54) E [{C{AU\t, x) + AV\t, x))) 6^^°* 


+ 


/ IV (AJ, 


s, X, U\ V\ V\ V\ U^-\ 


+AV^-\s,x) - AVys,x)) e^'^°^ds 

h f‘ 

+ J (tt(^AI{s,x,U\V\V\V\W-\V^-\V^-\V^-\z) 


i=i' 


+Ay* ^(s ,x,z) — AV^{s ,x,z)jj e^"<°^\jdsvj{dzj) 


< %{T + l)Ka,o 


~foX 


Next, it follows from (j5.53j) that 


(5.55) E 


sup |M*(t, x)| 


0<t<T 


< 

i=i 


sup 

0<t<T 


[\AU\s-,x)y 

Jo 


AJj{s-,x, U\ V\ V\ V\ W-\ V^-\ V^-\ V^-ye^^°^dWj{s) 


+ 2 E® 

i=i 


+4Y.E 

J = 1 


sup 

0<t<T 



0 JZ 


{AW{s-,x)y 


AIj{s-,x, U\V\ V\ V\ U^-\V^-\V^-\V^-\zj)e^"^°^N(Ajds, dzj) 


sup 

0<t<T 


[\AV\s-,x)y 

Jo 


+ 4 J 2 e 

J =1 


AJj{s-,x, U\ V\ V\ V\ ,V^-^,V^-^,V^-y 

+ {AV^-y,{s-,x) - {AVy,{s-,x)) e^^°^dWj{s)\] 

[AV\s-,x)y 


sup 

0<t<T 


to JZ 



/^j{s-,x, U\V\V\V\ U^-\V^-\V^-\V^-\zj) 

+ {AV'^~^)j{s~ ,x, Zj) — {AV^)j{s~ ,x, Zj)) e'^'^°^N{Xjds,dzj) 
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By the Burkholder-Davis-Gundy’s inequality (see, e.g., Theorem 48 in page 193 of Prot- 
ter 06]), the right-hand side of the inequality in (I5.55P is bounded by 


(5.56) \\AU\s-,x)\f 

{AJ^)j{s-,x, U\ V\ V\ V\ 




AIj(s-,x, U\ V\ V\ V\ e^^°^\jVj{dzj)ds 


+E^ 

i=i 


||Ar(s-,x)|f 


{AJ^)j{s-,x, U\ V\ V\ V\ 


+(AP*-^)j(s-,x) - (AP*)j(s-,x)f e^^°"ds 




AIj{s-,x, U\ V\ V\ V\ V^-\ V^-\ V'~\zj) 

2 


-|-(AP*)j(s ,x,Zj) — (AV^)j(s ,x,Zj) e^'^°^XjVj{dzj)ds 


where is some nonnegative constant depending only on and T. Furthermore, it 

follows from the direct observation that the quantity in (15.561) is bounded by 



(5.57) Kkfl E 


h 

+E 

1=1 


+ E 



sup \\AU\t,x)fe^^°^ 
, 0<t<T 


AJj{s-,x, U\ V\ V\ V\ P*-^) 




" AXj{s-,x, U\ V\ V\ V\ V^-\ zj) 



i\ 1 
2 



/o Jz 
e^'^°^Xji2j{dzj)ds) 


sup \\AV\t,x)fe‘^'^°^ 
. 0<t<T 
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E 


AJj(s-,x, U\V\V\V\ 


+(AV‘-’)j(a-,x) - (AV%(s-,x)fe^^'’‘ds 


+E 

i=i 



0 


ATj(s-,x, u\ v\ v\ v\ w-\v^-\ zj) 




+(Ay* ^)j(s ,x,Zj) — {AV^)j{s ,x,Zj) e^'^°^\jTZj{dzj)ds 


In addition, by the direct computation, we know that the quantity in (15.571) is dominated by 



(5.58) -E 


sup ||AC/*(t,a:)fe2T'°* 
0<t<T 


+dKLE 


+KoE 


Tr (aJ{s-, x,U\V\V\V\U^-^e‘^^°^ds 
J^Jo (aX(s-, X, U\ V\ V\ V\ W-\ V^-\ V^-\ V^-\z,)) 

e^'^°‘^Xji'j{dzj)ds] 


A- 


sup ||Ay*(t,x)fe2T'o* 
0<t<T 


EdKl^E 



T7 (^AJ{s-,x, U\ V\ V\ V\ W-\ V^-\ V^-^) 

+AI/*-i(s",x) - AV\s-,x)) e^T'o'ds)] 

(^Ai{s-,x, U\ V\ V\ V\ Zj) 


Tr 


Due to (I5.54p . the quantity in (I5.58P is bounded by 


Xj IXj yxMXxj j 


(5.59) 


E 


sup ||AC/*(t)||^o(^)e2^°* 
0<t<T 


+ E 


sup ||A7/*(t)||^o( 
0<t<T 


+UT + l)dKa,oK'^^o (A7/'-\ Ay'-\ AV^-\AV^-^) 


70.‘ 


where Ka,o is some nonnegative constant depending only on T, d, and Kd^. Thus, it follows 
from (12171) and (ICTP - dTMl) that 


(5.60) 


E 


sup ||AC/*(t)||^o e 


2'yot 


0<t<T 


+ E 


sup ||AI7'(t)||^o(,) e' 


270 i 


0<t<T 
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< 2 (1 + KaflUT + 1) (AC/'-\ A^-i, A^-i) 

Furthermore, it follows from (|5.5UI) and (12.171) that, for i G {3,4,...}, 


2 

70 . 


(5.61) 


E 

< 2E 


+2E 


< 2^oKcfl 


r'^ - 1 

j Tr{AV\s,x))e‘^'^°^ds 

Tr (^AJ{s-,x, U\ V\ V\ V\ C/*-\ 

+Ay*-i(s-,x) - AV\s,x)) e^T-o^ds] 

J TV (^Aj(s-,x, u\v\v\v\ u^-\v^-^) 

+AV^-\s-,x))e^^°^ds] 

i—l A TA*—1 A f>*—1 AT>* — 


+ 


(Al7^-\ AV^-\ AV^-\ Al^* 


(AU^-^, AV^-^, AV^-^, AV^-^) 


70.*: 


70.*:/ 


where iTc,o is some nonnegative constant depending only on Kjj^q a-nd T. Similarly, it follows 
from (|2.18l) that 


(5.62) 


h f.'j' 


E 


< 2E 


f f ^Tr ^At7*(s ,x,z)j'j Xjdsi'j{dzj) 

j J t J Z 3 

(^Tr (aX(s, X, U\ V\ V\ V\ W-\ V^-\ V^-\ V^-\z) 


h f.j' 

E 


t JZ 


+A17* ^(s ,x,z) — AV‘^{s ,x,z)jj e^'^°^\jdsvj{dzj) 


+2E 


h f.j' 

E 


i=i 


t JZ 


(^Tr (aX(s, X, U\ V\ V\ V\ W-\V^-\ V^-\ V^-^, z) 


+A’F* ^(s ,x, 2 ;)jj e^'^°^\jdsuj{dzj) 


< 2%Kcn 


+ 


(A[/*-y Ai/*-y Ai4*-y Ay*-^; 


(AC/*"^ Al/*-^ Al/*-^ AV^-^) 


u 

70 ,* 


70 .*/ 


Thns, by (I5.50p . (I5.60p - (l5.62p . and the fact that all fnnctions and norms used in this paper 
are continuous in terms of x, we have 

2 


(5.63) 


{AU\AV\AV\AV^ 


•^70,0 


40 
















































< JoKd,o 


AV^-\ AV^-\ AV^-^) 


Mi 


70 V 


+ 


{AW-^, AV^-^, AV^-"^, AV^-^) 


M° i, 
70,fc. 


where K^fi is some nonnegative constant depending only on Kd,q and T. 

Now, by Lemma 15.21 and the similar construction as in (I5.49p . for each c € {1,2,...}, we 
can define 


(5.64) C{AU‘^'\t,x) +AV^'\t,x)) = {Tv {AU^^\t,x)) + Tt {AV^^\t,x))) 

where 

AU^’\t,x)) = (A17(°)'*(t,a:)),At/W'*(t,x)),...,A17(^)’*(t,a:))', 
AV^’\t,x)) = (Ay(°)’*(t,x)),Al^(i)>*(t,x)),...,Al^(")’*(t,x))'. 


Then, it follows from the ltd’s formula and the similar discussion for (15.631) that 

2 


(5.65) 


< %Kd 


{AU\ AV\ AV\ AV^ 

i—l ATri—l A f>*—1 AT>i—1' 


7c.c 


+ 


< 


{AU^-\AV^-\AV^-\AV^ 

{AW-^, AV^-^, AV^-^, AV^-^] 
6 




^?c,. + c 


((c + l)^ 0 (c + 2y^...{c + ky^){r]{c + l)r]{c + 2)...r]{c + k)) 
' 2 


+ 


{AU^-\ AV^-^, AV^-^, AV^-y 
(A17*-^ A1/*-2, A1/*-2, A1/*-2' 


•^7fc + c,'' + ‘: 


•^7fe + c.*: + Cy 


where, for the last inequality of (I5.65p . we have taken the number sequence 7 such that 
7 o < 7 i < ••• and 


lcKd,c{{c + l)^°(c + 2)^°...(c + ky°){r]{c + 1)t]{c + 2)...t/(c + A:)) < 5 
for some d > 0 such that 2Ve^6 is sufficiently small. Hence, we have 


(5.66) 


{AU\ AV\ AV\ AVy 




< e^6 


+ 


(A^7*-^ AH*-\ AH*-\ AH*-i) 
(AH*"^ Al/*-^ AH*-^ AV^-y 
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Since (a^ + < a + 6 for a, 6 > 0, we have 


(5.67) 




< 


{AU\ AV\ AV\ AV^) 

{AW-^, AV^-^, AV^-^, AV^-^) 
AV^-^, Ay*-2' 


+ 






Therefore, by (I5.67p . we know that 

OO 

(5.68) ^||(At/^Al^^Ay^Ay*) 

{AU‘^, AV"^, AV‘^, AV^] 


i=3 




< 


\/ e^5 


1 - 


+ 


{AU\ AV\ AV\ AV^) 






< OO. 


Thus, from (|5.68p . we see that {W, V^, V^, V'^) with i G {1,2,...} forms a Cauchy sequence in 
A^:?[0,T], which implies that there is some (t/, V, V, V) such that 


7 

(5.69) {U\V\V\V^) ^ {U,V,V,V) as i ^ oo in M^[0,T]. 


Finally, by (I5.69|) and the similar procedure as used for Theorem 5.2.1 in pages 68-71 of 
0ksendal [39] , we can complete the proof of Lemma 15.31 □ 


5.2 Proof of Theorem 12.11 

By combining Lemmas 15.1115.31 we can reach a proof for Theorem 12.11 □ 

5.3 Proof of Theorem 12.21 

First, we consider a real-valued system corresponding to the case that r = T, whose proof 
is along the line of the one for Lemma 15.31 More precisely, for any given number sequence 
7 = {tDcjC = 0,1,2,...} with G R, replace the norm for the Banach space A1:^[0,T] 
defined in ()5.46l) by the one 


(5.70) 


{U,V,V,V) 




= E^(^) iU,V,V,V) 


c=0 


M 


Dc ’ 


for any given ([/, V,V,V) in this space, where 

2 


iU,V,V,V) 


Mi, 


= E 


sup 

0<t<T ^ ' 


27nc* 
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+E 

+E 

+E 


sup ||^(i)|lc-(D„q)e' 

0<t<T 


2'y D^t 


fwmw 

r\\vit) 

Jo 


^ dt 

C^{D^,qd) 




Then, it follows from the similar argument used for (I5.66P in the proof of Lemma 15.31 that 


{U\;X),V\;X),V\;X),V\;X,Z)) G Q^([0,r] X D) 


with {U^, V^, V^) = (0,0,0,0), where {U^,V^, ,V^) is defined through (|5.2p in Lemma[5T] 

Furthermore, over each Dc with c G {0,1,...}, we have that 


(5.71) 


{AU\AV\AV\AV^) 




< e^6 


+ 


AV^-^,AV^-^] 




(At/*"^ AV^-^) 


MO 


where 5 is a constant that can be determined by suitably choosing a number sequence 7 such 
that 'jDo < 7 z)i < and 0 < Ve^Sj{l — 2 V e^6) < 1 (note that 7 /)^ may depend on both 
and c for each cG {0,1,...}). Thus, it follows from p5.71l) that the remaining justification for 
Theorem 12.21 can be conducted along the line of proof for Theorem 12.11 

Second, we consider a real-valued system corresponding to the case that r is a general 
stopping time. The proof for this case can be accomplished by extending the proof corre¬ 
sponding to r = T via the techniques developed in Dai [MIEO] for both forward and backward 
SDEs, and the related discussions in Yong and Zhou [52]. 

Third, by direct generalizing the discussion concerning the real-valued system to complex¬ 
valued system, we reach a proof for Theorem 12.21 □ 


6 Proofs of Theorem 13.11 and Theorem 13.21 

To provide the proofs for Theorem 13.II and Theorem l4.ll we first recall the Skorohod problem 
and study some related properties. 


6.1 The Skorohod Problem 

Let D{[0,T], R^) with b G {p,2p} be the space of all functions z : [0, T] —)• that are right- 
continuous with left limits and are endowed with Skorohod topology (see, e.g., Billingsley [3|, 
Jacod and Shiryaev [28|). Then, we can introduce the Skorohod problem as follows. 
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Definition 6.1 (The Skorohod problem). Given z G D{[0,T], RP) with z(0) G D, a {D,R)- 
regulation of z over [0,T] is a pair {x,y) G D{[0,T], D) x D([0, such that 

x{t) = z{t) + Ry{t) for all t G [0,T], 

where, for each i G {1, b}, 

1- vm = 0, 

2. yi is nondecreasing, 

3. yi can increase only at a time t G [0,T] with x{t) G Fj. 

Furthermore, we define the modulus of continuity with respect to a function z{-) G -D([0, T], 
and a real number <5 > 0 by 

(6.1) w{z, (5, T) = inf maxOsc {z, [ti-i,ti )), 

h I 

where the infimum takes over all the finite sets {ti} of points satisfying 0 = fo < < 

tm = T and ti — f;_i > <5 for / = 1, m, and 

(6.2) Osc(z, [fi_i,f/]) = sup || 2 :(f) - z(s)||. 

ti <S<t<t2 

Then, we have the following lemma. 

Lemma 6.1 Suppose that the reflection matrix R in Definition satisfies the completely-S 
condition. Then, any {D, R)-regulation {x,y) of z G D{[0,T], R^) with 2:(0) G D satisfies the 
oscillation inequality over [tifi-fi with ti,t 2 G [0, T] 

(6.3) Osc{x,[ti,t 2 ]) < KOsc{z,[ti,t 2 ]), 

(6.4) Osc{y,[ti,t 2 ]) < KOsc{z,[ti,t 2 ]), 

where k is some nonnegative constant depending only on the inward normal vector N and 
the reflection matrix R. 

Proof. For each t G [ti,t 2 ], define 

(6.5) Az{t) = z{t) — z{t~), 

(6.6) Ax{t) = x{t) — x{t~), 

(6.7) Ay{t) = y{f)-y{t-). 

Since the reflection matrix R satisfies the completely-5 condition, it is easy to check that the 


linear complementarity problem (LCP) 


Ax{t) 

= Az{f) + RAy{t), 

Ax{t) 

e D, 

^y{t) 

> 0, 

Axi{t)Ayi{t) 

= 0 for i = 1, ...,p. 

{hi - Axi{f))Ayi{f) 

= 0 for z = p + 1,. 
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is completely solvable (see also Theorem 2.1 in Mandelbaum m for the related discussion). 
Furthermore, we can conclude that 

(6.8) ^y(i) < CAz{t) 

for some nonnegative constant C depending only on the inward normal vector N and the 
reflection matrix R. Then, the rest of the proof is the direct conclusion of the one for Theorem 

3.1 in Dai |14] or the one for Theorem 4.2 in Dai and Dai |12] . □ 

Lemma 6.2 Assume that {x"', y"') (x, y) along n G {1,2,...} in D([0, T], RP)xD{[0, T], R^) 

and y^{-) is of bounded variation for each n G {1,2,...}. Furthermore, suppose that 

(6.9) f f{x^{s))dy^{s) = 0 

Jo 

for all n G {1,2,...} and each t G [0, T], where f G C^{[0,T], R^) is a b-dimensional bounded 
vector function. Then, for each t G [0,T], we have that 

(6.10) f f{x{s))dy{s) = 0. 

Jo 

Proof. It follows from the definition in pages 123-124 of Billingsley [3] or Theorem 1.14 in 
page 328 of Jacod and Shiryaev [28] that there is a sequence { 7 , 1 , n G {1,2,...}} of continuous 
and strictly increasing functions mapping from [0, T] —)• [0,T] with 7 n( 0 ) = 0 and 7 n(P') = T 
such that 

( 6 . 11 ) sup | 7 n(t) - i| 0 , 

iG[0,T] 

( 6 . 12 ) sup |(x”,y”)( 7 n(t)) - (x,y)(f)| 0 . 

i6[0,T] 

Then, by the uniform convergence in (|6.1ip - (l6.12l) and the condition in ()6.9p . we know that 

[ fix{s))dy{s) = lim [ f{x'^{jn{s)))dy'^{jn{s)) 

Jo ^^°°Jo 

rln (i) 

= lim / f{x"-{u))dy^{u) 

n^ooJo 

= 0 , 

where 7 ^^(-) is the inverse function of 7 n(') for each n G {1,2,...}. Hence, we complete the 
proof of Lemma 16.21 □ 

6.2 Proof of Theorem 13.11 

We divide the proof of the theorem into four parts: Part A (Existence, Uniqueness), Part B, 
Part C, and Part D, which correspond to different boundary reflection conditions. 
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Part A (Existence). We consider the case that appeared in (13.ID - (13.21) is a 

constant and both of the forward and the backward SDEs have reflection boundaries. In this 
case, we need to prove the claim that there is an adapted weak solution ((A, Y), {V, V, V, F)) 
to the system in (II.3p . 

In fact, for a positive integer b, let Djr{[0,T], R^) be the space of i2^-valued and {Ft}- 
adapted processes with sample paths in D{[0,T], R!’). Furthermore, each Y G Djr{[0,T],R!’) 
is square-integrable in the sense that 


(6.13) 



< oo. 


In addition, we use p{[0,T], R^) to denote the corresponding predictable space. Then, for 
a given n G {1,2,...} and a 4-tuple 


(6.14) G D^[0,T],RP) X Djr{[0,T],R'^) X Djr^p{[0,T],R‘i^<^) 

xD^jr^p{[0,T]xRl,R'^^>^) 

with A”'(0) G D and V'^{T) G l), we have the following observation. 

By the study concerning the continuous dynamic complementarity problem (DCP) in 
Bernard and El Kharroubi [2] (see also the related discussions in Mandelbaum [35], Reiman 
and Williams m), Theorem 12.11 (and its proof) in the current paper, there is a 6-tuple 


((j^n-l-l ^n+1 ^”-+1)) 


€D^^{%T],RP)xD^^{%TIR^) 

xZ5^([0,T],R'?)xZ53.,p([0,T],R'?x'') 

xT)3r_p([0,r] X X 


for each n G {1,2,...}, satisfying the properties along each sample path: 

(6.15) A"+^(t) = A(0)+ Z"(t)+ Ry"+^(t) G T>, 

with 


Z"(t) 

Z^{t) 

z^t) 


and 

(6.16) 


znt) + znt), 

f b{s-,X^{s-), V^{s-), V^is-), V^{s-, ■),u{s-,X^{s-), ■)ds 
Jo 

f a{s-,X^{s-), V^{s-), V^{s-), V^{s-, X^{s-)),z, ■)dW{s) 

Jo 

+ f [ r^{s-,X^{s-),V^{s-),V^{s-),V^{s-,-),n{s-,X^{s-)),z,-)N{ds,dzy, 

Jo Jzf^ 


E^+i(i) = F(A"(r))-SF”(T) + [/’"(t) + SF”+^(t) gT), 
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with 


U^{t) = U^{t)-U^{t)-UUt), 


where, 

Unt) = l\is-,X^is-),V^is-),V^is-),V^is-,-)Ms-,X^is-),-)ds, 

U^{t) = (^a{s-,X^{s-),V^{s-),V^{s-),V^{s-,-), 

u{s-,X-is-)),-)-V^is-))dW{s) 

+ [as-,X^{s-), V^{s-). V'^is-), V^{s-, z), 

u{s-,X^{s-)), z, •) - V^{s-,z)^ N{ds, dz), 

U^{t) = [ V^+\s-)dW{s)+ [ [ V^^\s-,z)N{ds,dz). 

Jt Jt J z>^ 

Furthermore, satisfies the property (3) in Definition 14.41 In other words, y"-+^ 

is a 6-dimensional {J-t}-adapted process such that the ith component of y”'+^ for each 

i G {!,...,6} P-a.s. has the properties that Yi”'''“^(0) = 0, Y^^^^ is non-decreasing, and Y^^^^ 
can increase only when is on the boundary face Di, i.e., 

(6.17) f Id, {X^^Hs))dY;^+\s) = Y[^+\t) for all t > 0. 

Jo 

Similarly, F’’^+i) also satisfies the property (3) in Definition 14.41 More precisely, 

is a g-dimensional {Xij-adapted process such that the ith component of for each 

i G {1, ...,6} P-a.s. has the properties that = 0, is non-decreasing, and 

can increase only when 1/^+^ is on the boundary face Dj, i.e., 

(6.18) f Ij:,^{V^+\s))dFl^+\s) = Fl^+Ht) for all t > 0. 

Jo 

Next, we prove that the following sequence of stochastic processes along n G {1,2,...}, 


(6.19) 


^ ^Y^+1^, {V^+^ ,V^+\ F^+^)), {X^,V\V^,V^) = 0, 


is relatively compact in the Skorohod topology over the space 

(6.20) F[0,r] = F3r([0,r],F^’) X D^([0,r],F'') 

xD^([0,r],F'') xF3.,p([0,r],F‘?><'') 

xD^^p([0,r] X X D^([0,r],F''^^). 

Along the line of Dai [141118j , Dai and Dai m, and by Corollary 7.4 in page 129 of Ethier 
and Kurtz [23], it suffices to prove the following two conditions to be true: First, for each 
e > 0 and rational t > 0, there is a constant C{e,t) such that 

(6.21) liminfF|||H”f < C(e,t)| > 1 - e; 

n—>-cx) I j 
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Second, for each e > 0 and T > 0, there is a constant <5 > 0 such that 
(6.22) limsupP{t(;(H"',(5, T) > e} < e. 

n^oo 

To prove the two conditions stated in (|6.21l) and (|6.22l) . we hrst define the norm along 
each sample path 


[a,b] = sup II/(t) II 

a<t<b 


for each / G {X”, 2'”, U"', {V^, V^, V^)} and each a,b & [0, T], Then, we introduce the space 
for some constant 7 > 0 that will be chosen and explained in the following proof. 


(6.23) 


Q^[0,r] = D%i[0,T],RP) X DmO,T],R^) x R<^ 

'i2 /m Ky crh r)Q'xh\ 


xd\ 


xDj._p([0,T] xZ^i^'?x'*) 


endowed with the norm 


(6.24) 


(X,F,l/,y) 


Q-,[0,T] 


= E 


sup (||X(t)f + ||V(t)|| 2 )e 2 T 
46[0,T] 

T 


+ E 


rpwif 

To 




+E 


[ ||^^(t,-) 

To 




for each {X,V,V,V) G Q^[0,T]. Thus, by Lemma [ 6 Tl there is a positive constant Ci such 
that 


(6.25) 


||(j^n+l^yn+l)(^)|| 

< ||(x’^+\y”+i)(0)|| +kOsc(z’",[0,t]) 


< Cl 


+ 11 ^" 


l[ 0 ,T] 


and 

(6.26) 


< 

< 


{t) 

(F”+i,F"+\'(/”+i(.))(T) + ||F”+^(0)|| +2 kOsc(17’",[0,T]) 


< Cl ||(y’^(r)|| + ||F’^(r)|| + ||[/" 


< C 2 (i + ||x"(r)|| + ||c/^ 

< Ci(l + ||X(0)|| + ||Z 


\\[0,T] 
I [O.T] 


l[0,T] 

+ lic" 


l[ 0 ,r] 


n-l\\ +||[/n-l|| , llf/ni 


I [0,T] 


[0,T] 
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where, Ci and C 2 are some nonnegative constants. Furthermore, we have taken 
V^+\.)){T) = 0 in the third equality of (|6.28l) since the uniqueness for the Martingale 
representation is in the sense of up to sets of measure zero in (see, e.g.. Theorem 4.3.4 

in page 53 of 0ksendal |39] and Theorem 5.3.5 in page 266 of Applebaum m)- 

Thus, for each n S {1,2,...}, the given linear growth constant L > 0 in m, and any 
constant K > LT, it follows from the Markov’s inequality that 


(6.27) 


p{\\znT>K} < 


LT 


K -LT 


zE 


(^n^-^n,yn,yn(.)) 


[0,T]_ 


Furthermore, by Lemma 4.2.8 in page 201 of Applebaum [T] (or related theorem in page 20 
of Gihman and Skorohod |24] ') and the linear growth condition, we know that 


K T^T 

(6.28) P{\\Z-\\^>K} < 


(A^,F”,F”,F"(-)) 


[o,r] 


for all nonnegative constant K > L^T. In addition, similar to the illustration of ()6.27p . we 
have that 


(6.29) 


p{\\unT>K] < 


1 


zE 




[OT], 


K -LT 

Next, by the similar demonstration for (I6.28P and the linear growth condition, we know that 

2 


(6,30) P{\\u;\\t>K} < E + PPEe 


K - L^T 

Furthermore, by the proof of Theorem 12.11 we have that 




[0,T]_ 


(6.31) P{l|C3l,.>/f) <4+ 


7^2 {K-L^Ty 

_ i 

{K - L'^Tf 


+ 




StIoT], 


for some nonnegative constants Ki and K 2 . Therefore, for each given e > 0, it follows from 
(j6.27p - (l6.31l) . suitably chosen constants K and K, and the initial condition in (I6.19P that 
there is a nonnegative constant C such that 


(6.32) infP{||“"(t)|| < C, 0 < t < T} 

n 

> infmin{P{||(A:"+^y’"+l)(^)|| <C, 0 < t < T} , 


P 


I (y"+^P"+^F”+^F”+^)(^) <C, 0<t<T|| 


> 1 -e. 

Thus, the condition in (I6.2ip is satisfied by the sequence of {H”}. 
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Now, for any t G [0, T], it follows from the proof of Proposition 18 for a BSDE with jumps 
in Dai 116] and Lemma l 6 .II that 


(6.33) 


^Ijn^yn^yn 


Q-,[t,T] 


< K^{2L^{T -t)+ 


Q-rim 

T 




ds 


+K^ 


^yn-l ^yn-l ^yn-l) 




where, < 1 depending only on L, T, d, and h for some suitable chosen 7 > 0. Thus, by 
Lemma l 6 .11 the Ito’s isometry formula, and ()6.33p . we have that 


2 

im 


(6.34) E 

< Ki{E[\\V'^{T)f] + E [\\E^-\T)f] +K^E[OsciU^-\[t,T])^]) 


< Ki(l + E 


11 ^ 


n||2 


i[o.r] 


+ k^e [Osc{u^-^, [ o , r ]) 2 ] + k^e [Osc{u^-\ [ t , r ])^]) 


< Ki{1 + 24:K^L^T^+ 24k‘^L'^{T- tf) + KiE \\X^\\fo^T] 

ds + E 


+24KiK^L^T\ / E 


+24Kik^L^{T -t) 


11^ 

T 


n— 2 II2 

ll[0,s] 


ds + E 


E 




+241^1^2L^T ,V^-^ 


[o,d 


Qi{0,T] 


n—1 1|2 
\\lt,T] 


+4iLiK^ 


+4iLiK^ 


n—1 'i/n—1 {'/■n—l' 

+2AKik^L^{T -t) 

2 

Q-y[t,T] 


2 

Qi[tX] 


{jjn^yn^yn^ 


< K3 + K2{ E 


+ 


0 


11 ^^ 


i-l||2 

ll[o,d 


ds “h 




Q^[o,T] 


+ 


^jj-n—2 '^n—2 -^n—2^ 
2 

Qj[0,T] 


2 

Q-,lo,T] 


^Ijn^yn^yn 


where, Ki for i G {1,2,3} are some nonnegative constants depending only on T, L, k, and 
E [||P(r)|p]. Furthermore, for any t G [0,T], we have that 


(6.35) E \\X%^,^ 


< 2E 

< 2E 


||X(0)f] +2K^E[Osc{Z^-\[0,t])^] 

\\X{0)f^ 


+ Gk^LH'^ 


50 








































































I [0,5] 




< 2E 


E ds + E 

2 

Q7[0,t] 

||X(0)f 1 + 12K'^L‘^t^ + Qn^L^tE [||'l^^(r)||] 


[o,r] 


+QK^L^t 


+ 6 K^L^t / E 


/ 


\X 


n—l I 


I [0,5] 


ds 


+QK^L^t{l + 2K^) 

^ ^ Q7[o,t] 

Therefore, for any e > 0 and a constant 5 > 0, consider a finite set {t;} of points satisfying 
0 = to < ti < ... < tm = T and ti — ti_i = 6 < ejL with I e {1, ...m}. It follows from (I6.19p . 
(I6.33p - (j6.35l) . and the similar explanation for (I6.27P that 


(6.36) 


< 


< 


P{w{Z^,5,T)>e} 
3L‘^d 


(e - L6y 

3L‘^5 


E 


vTi 112 ill T/^ 11 ^ 

^ ll[0,T] + ll^ ll[0,T] 


+ 


(^U^^yn^yn) 


Q-y[0,T] 


Ao + Yl 


J^k + lrpk+l 


i + k!;)+A2J2k^]^ 


ie-LSyy-' + / 

where Aq, Ai, and A 2 are some constants depending only on L, T, d, and h. Furthermore, 
by Lemma 4.2.8 in page 201 of Applebaum [T] (or related theorem in page 20 of Gihman and 
Skorohod [23]) and the linear growth condition, we know that 


(6.37) P{w{Z^,5,T)>e} 

^ ■ 5E 


- e2 ^ e - 37.25 


IX" 


+ 6E 


lir 


■ n ||2 

T 


+ E 


{Ijn^yn^yr. 


QAOX] 


3L2 


^ e — 


<5Uo + E 


J^k + lryk+1 


^ (fc + 1)! 


1 + X;^) + 7 I 2 +AsJ2K- 


k=l 


k=l 


for all nonnegative constant e > 3L^6, where 7 I 3 is some constant depending only on L, T, 
d, and h. 

Similarly, there are some constants Bq, Bi, B 2 , and B^ depending only on L, T, d, and 
h such that 


(6.38) 


and 


< 


P{w{Ul^,d,T)>e} 


(e-w V ti 


k=l 


(6.39) P{u;(Z 2 ", 5 ,r) >e} 

- 3L2 ' ' 


6 ^ ^ e — 3L^S 


i B„ + E 




- (A: + l)! 


1 + K^] + B 2 E UbsE X 


k=l 


k=l 
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Hence, for each given e > 0, it follows from (|6.36|) - (l6.39p and suitably chosen constants e, 6, 
and 7 that 

(6.40) limsupP{u;(H"'),(5, T) > e} < e. 

n—)-oo 

Thus, the condition in (|6.22p is true for the sequence of {H”}. Hence, by (|6.28p . ()6.40p . and 
Corollary 7.4 in page 129 of Ethier and Kurtz [23], this sequence is relatively compact. There¬ 
fore, there is a subsequence of {H”} that converges weakly to H = ((X, Z,Y), (V,V,V, F)) 
over the space T’[0,T]. For convenience, we suppose that the subsequence is the sequence 
itself, i.e., 

(6.41) S” ^ E. 

Then, by the Skorohod representation theorem (see, e.g.. Theorem 1.8 in page 102 of Ethier 
and Kurtz [23]), we can assume that the convergence in (|6.4ip is a.s. in the Skorohod topology. 
Thus, by the claim (a) in Theorem 1.14 (or the claim (a) in Proposition 2.1) of Jacod and 
Shiryaev [28] and the facts that y”'’'^(0) = 0 and y”'+^ is nondecreasing, we can conclude 
that y(0) = 0 and Y is nondecreasing. Furthermore, by Lemma 16.21 and (|6.17l) 

(6.42) f lDAX{s))dYiis) = Yi{t) for all t > 0, i € {1,...,6}. 

Jo 

Similarly, we know that F{0) = 0, F is non-decreasing, and 

(6.43) [ Ir,.{V{s))dFi{s) = Fi{t) for all t > 0, ie{l,..., 6 }. 

Jo 

Therefore, by the Lipschitz condition in (|3.2I) . we know that {{X,Y), {V,V ,V, F)) satisfies 
the FB-SDEs in (ll.3p a.s. Thus, by the Skorohod representation theorem again, it is a weak 
solution to the FB-SDEs in (ll.3p . 

Part A (Uniqueness). Assume that {(X,Y), {V,V ,V, F)) is a weak solution to the 
FB-SDEs in (|1.3p . To prove its uniqueness, we introduce some additional notations. Let 
Dg = D, Z )0 = Z), and define 

(6.44) Dk = Cii^KDi, 

for each (b ^ K C {1,...,6} and each (b ^ K d {1,...,6}. In the sequel, we call a set 
K G {1,...,6} “maximal” if KT 7 ^ 0 , F>x 7 ^ 0 , and 7 ^ for any K D K such that 
K ^ K. Similarly, we can dehne the maximal set corresponding to a set K G {1,...,6}. 
Furthermore, let d{x,FK) and d{x,Ff^) respectively denote the Euclidean distance between 
X and Fk for a point x G F and the Euclidean distance between a point x G F and Fj^. 
Then, it follows from Lemma 3.2 in Dai m or Lemma B.l in Dai and Williams m that 
there exist two constants C > 1 and C >1 such that 

(6.45) d{x, Fk) < C ■ x — bi), d{x, F^) — ^ ■ x — hi). 

i&K i£K 
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Now, for each e > 0, K £ {1, and K G {1,6} (including the empty set), we let 

(6.46) = {x £ : 0 < Ui ■ X — bi < for all i £ K, 

rii ■ X — bi > e for all i £ {1,..., 6} \ K} , 

(6.47) = {^x £ R ■. Q < fii ■ X — hi < Ce for all i £ K, 

ni-x — bi>€ for all z G {1,..., 6} \ , 

where = Cpe and = Cqe. Thus, by Lemmas 4.1-4.2 in Dai and Williams m, we know 
that 

(6.48) D = ^ 

where, Q is the collection of subsets of {1,..., 6} consisting of all maximal sets in {1,..., 6} and 
Q is defined in the same way in terms of subsets of {1,..., 6}. For convenience, we order the sets 
in Q and Q. Then, we can define a sequence of 3-dimensional points {(r^, fn,Tn),n £ {1, 2,...}} 
with To = 0 by induction. 

In fact, since {{X,Y), {V, V, V, F)) is a weak solution to the FB-SDEs in ()1.3p . both X(0) 
and E(0) are defined. Thus, if (ri,fi) is the first K x K £ {1,...,6} x {1,...,6} such that 
{x,x) £ X we let 

(6.49) Ti = inf {t > 0 : (X(t),E(t)) ^ x . 

Furthermore, if {rn,rn,Tn) has been defined on {xn < oo}, we let {rn+iifn+i) be the first 
K X K £ Q X Q such that (X(rn), V(rn)) £ x Then, we can define 

(6.50) Tn+i = inf |t > Tn : {X{t),V{t)) ^ x • 

On {xn = +oo}, we define r^+i = r^, r^+i = fn, and Xn+i = t^. Due to the right-continuity of 
the sample paths of solution {X, V) by the related property of Levy process driven stochastic 
integral (see, e.g.. Theorem 4.2.12 in page 204 of Applebaum m), {xn] is a nondecreasing 
sequence of {J-i}-stopping times, satisfying —)• oo a.s. as n —)• oo. 

Hence, it suffices to prove the weak uniqueness of ((X, Y), (E, V, E, F)){- A t„) for each n. 
Note that both and Z)t^ for each n are subsets of cones. Thus, without loss of generality, 
we assume that both D and D are cones. Therefore, we can prove the weak uniqueness by 
induction in terms of the numbers of boundary faces of D and D. 

In fact, for the case that 6 = 6 = 1, it follows from the uniqueness of the Skorohod 
mapping given by Lemma 3.1 in Dai [H] or Lemma 4.5 in Dai and Dai |12] that the weak 
uniqueness is true. Now, we suppose that the weak uniqueness is true for the case that 
b + b = m > 2 with 6 > 1 and 6 > 1. Then, we can prove the case for 6 -|- 6 = m -|- 1. In this 
case, we need to consider two folds indexed by two pairs of {b + 1, b) and {b, b + 1). Both of 
the folds can be proved by the similar discussion for Theorem 5.4 in Dai and Williams m- 
Therefore, we finish the proof of weak uniqueness. 
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Part B. We consider the case that L{t,uj) appeared in (I3.1l) - (|3.2p is a constant and the 
spectral radii of S and each pxp sub-principal matrix of N'R are strictly less than one. In this 
case, we need to prove that there is a unique strong adapted solution ((X, Y), {V, V, V, F)) 
to the system of in (11.311 . 

In fact, it follows from the discussions in Reiman and Harrison [27], Dai [TS], Lemma 

7.1 and Theorem 7.2 in pages 164-165 of Chen and Yao m that there exist two Lipschitz 
continuous mappings <I> and T such that 

(6.51) 

(6.52) (y^+i^i?’^+i) = ^([/’^) 

for each n G {1,2,...}. Then, it follows from (I6.5ip - (I6.52I) . the related estimates in Part A, 
and the conventional Picard’s iterative method, we can reach a proof for the claim in Part B. 

Part C. We consider the case that appeared in (|3.1ll - ()3.2p is a constant and 

both of the SDEs have no reflection boundaries. In this case, we need to prove that there is a 
unique strong adapted solution ((X, Y), (P, V, V, F)) to the system of in (11.31) . In fact, by the 
related estimates in Part A, this case can be proved by directly generalizing the conventional 
Picard’s iterative method. Actually, this case is a special one of Theorem 12.II or Theorem l2.2l 

Part D. We consider the case that L{t, oj) appeared in (I3.ip - (|3.2I) is a general adapted and 
mean-squarely integrable stochastic process. The proofs corresponding to the cases stated 
in Part A, Part B, and Part C can be accomplished along the lines of proofs for Lemma 

4.1 in Dai HU associated with a forward SDE under random environment and Proposition 
18 in Dai [20] for a backward SDE under random environment. The key in the proofs is to 
introduce the following sequence of {Xt}-stopping times, i.e., 

(6.53) = inf{t > 0, ||L(t)|| > re} for each re G {1,2,...}. 

By the condition in (13.6p . is nondecreasing and a.s. tends to infinity as re —)> oo. 

Finally, by summarizing the cases presented in Part A to Part D, we finish the proof of 
Theorem 13.11 □ 

6.3 Proof of Theorem 13.21 

For a control process u* G C, it follows from Theorem 12.11 that the (r, g -|- l)-dimensional 
FB-SPDEs in (jl.ll) with the partial differential operators {C,j,X} given by (I3.7p - (l3.12p and 
terminal condition in ()3.13p indeed admits a well-posed 4-tuple solution {U(t,x), V{t,x), 
V{t,x), V{t,x,-)). Thus, substituting 

(P(t), V{t), V{t, •)) = {V{t, X{t)), Vit, X{t)), V{t, X{t), •)) 

into the system of coupled FB-SDEs in (11.31) . it follows from Theorem 13.II that the claims in 
Theorem 13.21 are true. □ 


54 














7 Proof of Theorem 14.11 


The proof of part 1 is the direct extension of the single-dimensional case (i.e., p = q = 1) for 
the related optimal control problem in 0ksendal et al. |41] . 

The proof of part 2 can be done as follows. For each u G C and = I3{t,x) = 0, 

it follows from Theorem 13.21 that the regulator processes F{t) and Y{t) exist. Since they 
are nondecreasing with respect to time variable t, the derivatives ^{t,x) and ^{t,x) exist 
a.e. in terms of time variable t along each sample path a.s. Furthermore, if each q x q 
sub-principal matrix of N'S and each p x p sub-principal matrix of N'R are invertible, 
these derivatives are uniquely determined owing to the Skorohod mapping. Nevertheless, 
if only the general completely-iS condition is imposed, these derivatives are weakly unique in 
a probability distribution sense. In addition, it follows from Proposition 7.1 in Ethier and 
Kurtz [23] that these derivatives can be approximated by polynomials in terms of variable x 
for each given t, which are denoted by 'y{t,x) and j3{t,x). Then, the proof for the claim in 
part 2 follows from the one for the claim in part 1. Hence, we reach a proof for Theorem 14.11 
□ 
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